-- Logs begin at Mon 2022-08-29 20:44:31 UTC, end at Mon 2022-08-29 22:07:48 UTC. -- Aug 29 21:41:05.685274 dv-cinder-854266-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 21:41:05.694166 dv-cinder-854266-3-smb devstack@n-api.service[112849]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 21:41:05.696283 dv-cinder-854266-3-smb devstack@n-api.service[112849]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 21:41:05 2022] *** Aug 29 21:41:05.696283 dv-cinder-854266-3-smb devstack@n-api.service[112849]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 21:41:05.696283 dv-cinder-854266-3-smb devstack@n-api.service[112849]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 21:41:05.696283 dv-cinder-854266-3-smb devstack@n-api.service[112849]: nodename: dv-cinder-854266-3-smb Aug 29 21:41:05.696283 dv-cinder-854266-3-smb devstack@n-api.service[112849]: machine: x86_64 Aug 29 21:41:05.696283 dv-cinder-854266-3-smb devstack@n-api.service[112849]: clock source: unix Aug 29 21:41:05.696283 dv-cinder-854266-3-smb devstack@n-api.service[112849]: pcre jit disabled Aug 29 21:41:05.696283 dv-cinder-854266-3-smb devstack@n-api.service[112849]: detected number of CPU cores: 4 Aug 29 21:41:05.696283 dv-cinder-854266-3-smb devstack@n-api.service[112849]: current working directory: / Aug 29 21:41:05.696283 dv-cinder-854266-3-smb devstack@n-api.service[112849]: detected binary path: /usr/bin/uwsgi-core Aug 29 21:41:05.697560 dv-cinder-854266-3-smb devstack@n-api.service[112849]: your processes number limit is 47680 Aug 29 21:41:05.697560 dv-cinder-854266-3-smb devstack@n-api.service[112849]: your memory page size is 4096 bytes Aug 29 21:41:05.697560 dv-cinder-854266-3-smb devstack@n-api.service[112849]: detected max file descriptor number: 2048 Aug 29 21:41:05.697560 dv-cinder-854266-3-smb devstack@n-api.service[112849]: lock engine: pthread robust mutexes Aug 29 21:41:05.698155 dv-cinder-854266-3-smb devstack@n-api.service[112849]: thunder lock: enabled Aug 29 21:41:05.698155 dv-cinder-854266-3-smb devstack@n-api.service[112849]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 21:41:05.698155 dv-cinder-854266-3-smb devstack@n-api.service[112849]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 21:41:05.738527 dv-cinder-854266-3-smb devstack@n-api.service[112849]: Python main interpreter initialized at 0x55bf4b8ed9c0 Aug 29 21:41:05.738527 dv-cinder-854266-3-smb devstack@n-api.service[112849]: python threads support enabled Aug 29 21:41:05.738527 dv-cinder-854266-3-smb devstack@n-api.service[112849]: your server socket listen backlog is limited to 100 connections Aug 29 21:41:05.738527 dv-cinder-854266-3-smb devstack@n-api.service[112849]: your mercy for graceful operations on workers is 90 seconds Aug 29 21:41:05.738971 dv-cinder-854266-3-smb devstack@n-api.service[112849]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 21:41:05.738971 dv-cinder-854266-3-smb devstack@n-api.service[112849]: *** Operational MODE: preforking *** Aug 29 21:41:05.739280 dv-cinder-854266-3-smb devstack@n-api.service[112849]: *** uWSGI is running in multiple interpreter mode *** Aug 29 21:41:05.739280 dv-cinder-854266-3-smb devstack@n-api.service[112849]: spawned uWSGI master process (pid: 112849) Aug 29 21:41:05.739542 dv-cinder-854266-3-smb systemd[1]: Started Devstack devstack@n-api.service. Aug 29 21:41:05.741352 dv-cinder-854266-3-smb devstack@n-api.service[112849]: spawned uWSGI worker 1 (pid: 112850, cores: 1) Aug 29 21:41:05.741352 dv-cinder-854266-3-smb devstack@n-api.service[112849]: spawned uWSGI worker 2 (pid: 112851, cores: 1) Aug 29 21:41:05.741352 dv-cinder-854266-3-smb devstack@n-api.service[112849]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 21:41:06.438575 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:41:06.451492 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:41:07.534494 dv-cinder-854266-3-smb devstack@n-api.service[112850]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:41:07.534494 dv-cinder-854266-3-smb devstack@n-api.service[112850]: from cryptography.utils import int_from_bytes Aug 29 21:41:07.535197 dv-cinder-854266-3-smb devstack@n-api.service[112850]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:41:07.535197 dv-cinder-854266-3-smb devstack@n-api.service[112850]: from cryptography.utils import int_from_bytes Aug 29 21:41:07.536378 dv-cinder-854266-3-smb devstack@n-api.service[112851]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:41:07.536378 dv-cinder-854266-3-smb devstack@n-api.service[112851]: from cryptography.utils import int_from_bytes Aug 29 21:41:07.536848 dv-cinder-854266-3-smb devstack@n-api.service[112851]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:41:07.536848 dv-cinder-854266-3-smb devstack@n-api.service[112851]: from cryptography.utils import int_from_bytes Aug 29 21:41:10.065415 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:41:10.065993 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:41:10.066178 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:41:10.066533 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:41:10.066784 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:41:10.067168 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.067487 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.067655 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:41:10.068007 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.068089 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:41:10.068166 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.068424 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.068556 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:41:10.068753 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.068839 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:41:10.069069 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.069154 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:41:10.069392 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.069550 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.069710 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.069810 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.069966 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.070067 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.070278 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.070370 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.070594 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854266-3-smb {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.070698 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.070907 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.071017 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.071205 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.071290 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.071508 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.071616 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.071819 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.071946 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.072116 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.072201 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.072430 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.072566 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.072776 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.072881 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854266-3-smb {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.073269 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.073676 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.073676 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.073901 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.074072 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.074192 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.074304 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.074432 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.074549 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.074662 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.074826 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.074921 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.075144 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.075283 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.075512 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.075640 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.075816 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.075952 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.076136 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.076248 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.076443 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.076575 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.076872 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854266-3-smb {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.076966 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.077182 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.077316 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.077488 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.077576 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.077802 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.077887 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.078113 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.078248 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.078442 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.078535 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.078754 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.078848 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.079098 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.079247 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854266-3-smb {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.079418 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.079562 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.079697 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.079875 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.080030 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.080223 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.080346 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.080676 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.080766 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.080996 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.081135 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.081288 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.081406 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.081598 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.081713 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.081900 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.082046 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.082211 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.082355 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.082502 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.082633 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.082801 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.082939 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.083089 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.083306 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.083441 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.083583 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.083721 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.083850 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.083988 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.084139 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.084270 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.084403 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.084549 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.084681 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.084834 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.084965 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.085102 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.085242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.085395 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.085535 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.085721 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.085857 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.085991 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.086174 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.086311 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.086459 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.086600 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.086762 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.086900 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.087044 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.087182 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.087312 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.087442 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.087577 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.087714 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.087896 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.088041 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.088217 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.088348 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.088558 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.088715 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.088930 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.089038 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.089242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.089326 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.089555 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.089639 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.089862 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.089955 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.090166 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.090257 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.090474 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.090557 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.090792 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.090885 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.091099 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.091219 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.091407 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.091517 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.091716 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.091827 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.092015 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.092157 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.092299 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.092436 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.092631 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.092762 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.092943 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.093031 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.093269 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.093493 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.093657 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.093824 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.093962 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.094096 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.094226 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.094375 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.094506 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.094636 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.094806 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.094935 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.095120 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.095260 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.095430 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.095567 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.095771 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.095901 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.096092 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.096241 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.096383 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.096570 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.096704 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.096790 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.097005 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.097104 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.097307 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.097393 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.097608 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.097693 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.097908 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.097995 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.098204 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.098380 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.098533 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.098692 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.098848 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.099080 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.099173 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.099388 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.099481 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.099698 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.099797 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.100008 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.100096 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.100312 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.100426 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.100642 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.100781 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.100943 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.101094 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.101250 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.101406 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.101562 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.101714 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.101861 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.102021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.102157 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.102327 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.102464 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.102647 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.102784 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.103043 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.103132 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.103353 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.103455 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.103654 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.103825 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.103986 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.104154 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.104247 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.104384 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.104658 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.104755 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.104912 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.105053 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.105223 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.105415 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.105706 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.105807 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.105888 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.105974 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.106201 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.106311 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.106398 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.106476 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.106681 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.106768 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.106972 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.107826 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.108042 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.108131 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.108211 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.108650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.108885 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.108994 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.109143 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.109224 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.109302 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.109434 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.109530 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.109611 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.109689 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.109950 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.110086 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.110173 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.110266 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.110346 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.110470 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.110552 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.110636 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.110716 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.110963 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.112590 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.112690 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.112778 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.112994 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.113130 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.113213 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.113298 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.113399 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.113481 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.113559 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.113645 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.113793 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.113881 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.113959 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.114037 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:41:10.114116 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.114202 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.114289 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.114377 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.114473 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.114564 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.114728 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.114914 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.115092 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.115185 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.115329 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.115463 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.115586 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.115774 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.115860 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.116100 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.116273 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.116418 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.116595 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.116769 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.116900 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.117090 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.117182 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.117453 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.117562 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.117760 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.117847 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.118088 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.118237 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.118400 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.118503 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.118708 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.118807 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.119009 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.119104 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.119314 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.119410 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.119633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.119779 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.119956 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.120098 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.120305 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.120450 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.120699 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.120861 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.120998 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.121142 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.121282 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.121380 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.121462 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.121649 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.121758 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.121995 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.122106 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.122322 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.122598 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.122694 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.122862 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.122977 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.123161 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.123252 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.123483 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.123633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.123774 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.123917 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.124091 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.124204 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.124415 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.124544 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.124800 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.124933 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.125175 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.125311 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.125474 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.125624 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.125793 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.125947 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.126118 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.126270 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.126433 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.126584 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.126740 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.126857 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.127633 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.127738 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.127953 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.128047 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.128293 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.128703 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.128863 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.128954 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.129049 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.129160 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.129322 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.129482 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.129621 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.129755 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.129944 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.130085 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.130243 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.130378 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.130528 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.130671 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.130826 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.130974 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.131132 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.131277 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.131428 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.131570 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.131723 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.131866 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.132030 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.132217 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.132356 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.132560 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.132732 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.132948 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.133111 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.133256 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.133398 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.133544 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.133683 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.133923 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.134130 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.134272 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.134403 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.134520 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.134642 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.134799 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.134928 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.135054 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.135188 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.135328 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.135437 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.135578 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.135678 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.135893 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.135980 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.136300 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.136397 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.136632 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.136720 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.136956 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.137058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.137269 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.137366 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.137579 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.137668 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.137879 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.137964 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.138188 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.138283 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.138490 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.138576 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.138789 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.138874 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.139088 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.139183 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.139391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.139477 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.139688 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.139785 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.139987 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.140091 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.140285 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.140407 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.140608 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.140733 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.140905 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.141050 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.141221 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.141390 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.141522 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.141725 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.141819 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.142036 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.142129 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.142363 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.142448 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.142724 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.142821 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.143043 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.143137 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.143347 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.143431 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.143657 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.143751 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.143965 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.144051 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.144271 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.144367 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.144598 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.144689 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.144910 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.144996 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.145213 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.145297 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.145518 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.145614 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.145823 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.145908 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.146127 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.146211 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.146426 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.146512 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.146736 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.146819 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.147042 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.147129 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.147342 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.147428 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.147643 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.147727 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.147948 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.148041 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.148266 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.148351 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.148589 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.148679 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.148901 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.149002 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.149234 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.149332 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.149560 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.149654 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.149871 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.149965 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.150184 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.150269 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.150488 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.150578 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.150798 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.150892 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.151100 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.151184 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.151407 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.151491 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.151712 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.151809 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.152020 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.152106 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.152331 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.152433 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.152662 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.152750 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.153043 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.153158 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.153278 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.153394 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.153596 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.153710 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.153903 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.154034 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.154256 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.154352 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.154512 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.154643 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.154820 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.154985 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.155144 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.155319 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.155461 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.155886 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.156012 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.156289 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.156375 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.156639 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.156743 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.156944 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.157035 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.157250 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.157343 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.157555 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.157644 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.157857 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.157952 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.160162 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.162300 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.162407 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.162486 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.162573 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.162652 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.162739 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.162819 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.162913 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.163035 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.163248 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.163337 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.163424 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.163512 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.163604 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.163684 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.163769 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.163848 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.163934 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.164022 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.164101 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.164179 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.164257 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.164323 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.164395 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.164469 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.164633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.164712 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.164790 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.164867 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.164945 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.165036 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.165116 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.165194 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.165278 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.165368 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.165447 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.165527 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.165612 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.165691 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.165768 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.165844 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.165929 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.166008 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.166093 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.166172 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.166249 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.166326 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.166412 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.166491 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.166575 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.166695 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.166787 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.166867 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.166954 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.167033 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.167111 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.167188 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.167266 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.167343 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.167434 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.167514 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.167591 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.167670 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.167775 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.167870 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.168079 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.168165 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.168400 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.168512 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.168737 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.168834 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.169045 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.169122 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.169355 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.169507 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.169670 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.169811 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.169974 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.170111 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.170278 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.170407 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.170582 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.170729 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.170880 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.171024 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.171188 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.171318 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.171500 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.171591 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.171827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.172084 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.172174 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.172412 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.172539 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.172772 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.172877 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.173085 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.173244 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.173398 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.173500 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.174237 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.174355 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.174548 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.174643 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.174866 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.174953 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.175179 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.175302 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.175483 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.175617 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.175789 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.175883 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.176091 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.176184 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.176390 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.176473 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.176726 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.176853 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.177054 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.177277 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.177363 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.177435 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.177617 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.177721 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.177921 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.178009 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.178220 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.178517 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.178594 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.178820 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.178909 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.179119 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.179207 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.179429 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.179514 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.179726 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.179821 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.180032 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.180153 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.180330 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.180505 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.180672 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.180846 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.180982 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.181171 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.181282 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.181485 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.181668 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.181848 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.182073 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.182163 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.182389 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.182475 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.182697 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.182792 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.183007 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.183093 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.183319 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.183440 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.183627 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.183731 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.183939 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.184027 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.184237 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.184322 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.184595 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.184687 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.184870 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.184964 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.185170 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.185278 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.185469 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.185558 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.185772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.185868 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.186075 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.186172 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.186373 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.186462 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.186678 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.186767 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.186983 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.187079 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.187308 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.187408 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.187589 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.187676 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.187888 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.187997 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.188187 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.188282 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.188498 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.188589 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.188819 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.188917 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.189193 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.189294 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.189474 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.190187 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.190281 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.190459 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.190845 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.190956 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.191131 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.191231 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.191327 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.191409 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.191526 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.191663 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.191815 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.191964 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.192115 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.192254 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.192405 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.192536 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.192657 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.192792 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.192936 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.193114 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.193241 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.193419 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.193563 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.193731 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.193821 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.194042 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.194147 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.194352 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.194447 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.194663 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.194806 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.194969 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.195055 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.195280 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.195365 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.195578 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.195706 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.195964 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.196061 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.196182 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.196277 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.196510 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.196600 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.198638 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.198780 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.198780 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.198951 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.199032 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.199111 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.199189 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.199383 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.199466 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.199555 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.199707 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.199793 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.199872 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.199957 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.200044 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.201186 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.201279 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.201360 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.201440 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.201647 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.201740 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.201831 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.202073 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.202824 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.202926 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.203018 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.204128 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.204267 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.204397 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.204504 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.204577 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.204656 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.204785 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.204923 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.205011 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.205090 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.205169 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.205255 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.205345 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.205425 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.205502 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.205580 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.205658 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.205753 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.205889 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.205981 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.206069 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.206149 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.206234 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.206321 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.206412 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.206492 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.206576 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.206655 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.206732 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.206839 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.206966 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.207067 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.207153 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.207235 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.207315 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.207408 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.207491 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.207581 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.207662 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.207742 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.207821 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.207910 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.207999 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.208087 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.208174 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.208266 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.208365 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.208532 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.208698 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.208853 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.209007 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.209162 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.209320 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.209463 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.209605 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.209745 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.209745 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.210019 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.210181 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.210326 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.210471 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.210618 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.210758 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.210916 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.211165 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.211319 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.211472 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.211613 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.211758 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.211904 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.212060 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.212209 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.212353 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.212353 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.212655 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.212818 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.213036 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.213192 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.213335 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.213481 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.213622 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.213763 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.213982 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.214143 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.214245 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.214314 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.214396 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.214474 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.214542 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.214616 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.214684 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.214825 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.214968 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.215184 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.215341 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.215486 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.215632 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.215832 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.215998 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.216228 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.216380 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.216563 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.216758 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.216918 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.217089 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.217201 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.217395 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.217529 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.217712 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.217874 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.218033 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.218196 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.218343 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.218490 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.218633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.218774 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.218992 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.219141 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.219284 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.219428 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.219573 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.219717 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.219886 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.220033 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.220177 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.220326 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.220596 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.220727 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.220834 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.220904 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.221159 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.221326 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.221489 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.221593 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.221792 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.221902 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.222094 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.222182 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.222416 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.222532 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.222813 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.223006 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.223087 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.223162 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.223394 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.223496 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.223699 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.223835 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.224004 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.224102 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.224409 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.224521 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.224746 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.224848 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.225054 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.225191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.225356 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.225445 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.225662 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.225765 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.225976 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.226080 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.226275 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.226366 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.226589 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.226728 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.226893 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.227046 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.227182 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.227322 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.227499 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.227587 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.227803 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.227927 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.228109 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.228228 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.228407 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.228576 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.228757 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.228846 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.229143 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.229407 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.229567 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.229694 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.229781 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.229850 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.230079 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.230199 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.230405 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.230622 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.230792 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.230953 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.231103 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.231263 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.231407 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.231547 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.231686 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.231821 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.231966 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.232086 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.232220 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.232358 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.232531 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.232660 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.232801 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.232926 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.233069 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.233222 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.233348 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.233485 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.233647 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.233977 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.234145 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.234270 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.234391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.234519 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.234653 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.234782 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.234893 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.235174 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.235328 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.235453 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.235574 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.235696 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.235816 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.236074 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.236724 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.236874 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.236998 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.237160 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.237443 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.237599 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.237744 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.237895 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.238030 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.238171 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.238307 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.238439 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.238571 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.238722 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.238858 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.238990 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.239121 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.239253 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.239426 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.239560 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.239812 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.239941 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.240348 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.240548 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.240720 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.240821 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.241083 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.241178 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.241415 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.241641 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.241744 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.242017 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.242114 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.242347 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.242434 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.242746 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.242848 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.243070 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.243241 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.243406 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.243716 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.243879 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.244065 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.244272 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.244371 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.244652 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.244745 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.244964 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.245061 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.245297 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.245396 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.245646 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.245745 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.245951 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.246046 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.246272 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.246375 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.246605 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.246780 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.246936 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.247248 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.247365 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.247583 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.247915 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.248010 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.248262 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.248528 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.248622 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.248927 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.249061 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.249244 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.249552 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.249639 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.249865 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.250163 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.250251 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.250472 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.250721 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.250808 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.251083 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.251341 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.251437 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.251687 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.251976 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.252590 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.252901 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.253107 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.253244 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.253524 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.253689 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.253839 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.254181 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.254293 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.254459 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.254771 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.254878 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.255118 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.255426 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.255543 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.255762 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.255980 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.256104 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.256388 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.256573 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.256736 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.257007 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.257096 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.257364 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.257652 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.257747 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.257990 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.258186 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.258357 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.258679 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.258764 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.258993 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.259264 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.259353 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.259624 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.259852 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.259948 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.260439 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.260612 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.260956 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.261276 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.261481 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.261594 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.261910 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.262098 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.262230 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.262548 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.262642 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.262864 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.263179 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.263307 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.263494 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.263785 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.263873 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.264125 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.264373 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.264473 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.264790 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.264877 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.265129 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.265380 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.265470 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.265759 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.265957 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.266061 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.266375 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.266530 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.266732 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.267051 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.267138 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.267359 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.267708 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.267808 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.268027 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.268292 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.268387 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.268680 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.268928 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.269067 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.269304 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.269544 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.269633 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.269918 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.270133 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.270231 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.270525 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.270726 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.270839 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.271167 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.271314 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.271498 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.271822 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.271969 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.272122 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.272434 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.272562 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.272773 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.273152 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.273310 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.273630 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.273731 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.273967 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.274293 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.274417 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.274620 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.274885 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.274976 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.275243 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.275456 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.275562 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.275869 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.275993 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.276178 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.276504 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.276602 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.276821 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.277048 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.277155 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.277434 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.277590 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.277743 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.278051 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.278164 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.278367 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.278679 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.278774 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.279225 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.279314 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.279576 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.279785 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.279881 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.280206 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.280357 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.280556 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.281209 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.281311 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.281520 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.281839 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.281977 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.282147 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.282438 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.282569 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.282753 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.283024 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.283157 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.283413 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.283637 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.283732 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.284019 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.284329 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.284710 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.284826 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.284960 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.285221 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.285320 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.285583 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.285803 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.285900 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.286151 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.286266 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.286478 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.286595 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.286794 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.287105 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.287201 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.287414 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.287720 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.287822 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.288026 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.288308 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.288405 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.288657 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.288919 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.289025 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.289268 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.289467 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.289570 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.289875 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.290041 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.290186 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.290543 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.290639 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.290864 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.291161 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.291249 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.291461 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.291745 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.291835 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.292074 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.292327 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.292454 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.292720 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.292929 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.293018 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.293370 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.293532 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.293686 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.294109 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.294244 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.294581 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.294904 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.295114 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.295240 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.295574 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.295751 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.295884 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.296193 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.296317 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.296536 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.296848 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.296936 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.297162 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.297474 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.297570 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.297786 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.298098 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.298191 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.298474 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.298677 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.299408 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.299738 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.299827 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.300052 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.300350 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.300437 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.300700 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.300949 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.301039 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.301314 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.301541 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.301629 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.301925 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.302124 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.302242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.302589 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.302674 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.302917 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.303244 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.303332 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.303561 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.303833 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.303921 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.304183 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.304424 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.304544 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.304819 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.305037 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.305214 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.305440 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.305605 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.305771 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.306650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.306959 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.307049 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.307127 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.307195 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.307195 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.307314 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.307411 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.307738 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.307882 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.308052 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.308375 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.308539 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.308724 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.309041 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.309143 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.309365 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.309649 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.309739 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.310005 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.310226 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.310350 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.310682 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.310799 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.311009 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.311317 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.311482 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.311624 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.311928 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.312023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.312239 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.312526 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.312630 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.312884 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.313111 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.313206 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.313478 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.313691 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.313795 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.314081 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.314280 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.314445 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.315249 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.315364 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.315556 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.315864 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.315951 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.316171 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.316490 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.316592 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.316805 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.317112 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.317199 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.317416 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.317720 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.317815 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.318029 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.318296 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.318384 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.318626 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.318888 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.318988 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.319225 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.319471 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.319599 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.319854 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.320070 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.320188 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.320603 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.320779 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.320955 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.321237 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.321415 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.321570 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.321859 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.322014 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.322163 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.322495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.322668 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.322826 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.323107 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.323443 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.323621 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.323769 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.324057 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.324208 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.324355 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.324693 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.324847 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.325009 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.325299 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.325450 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.325631 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.325959 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.326103 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.326255 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.326563 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.326698 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.326889 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.327136 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.327225 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.327514 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.327701 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.327830 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.328159 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.328283 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.328474 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.328811 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.328897 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.329126 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.329426 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.329515 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.329750 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.329845 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.330100 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.330192 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.330418 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.330735 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.330832 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.331056 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.331311 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.331400 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.331689 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.331888 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.332016 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.332331 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.332417 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.332686 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.332943 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.333041 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.333356 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.333524 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.333674 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.334021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.334114 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.334353 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.334671 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.334759 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.334986 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.335080 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.335295 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.335539 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:41:10.335654 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.336220 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.336884 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.337484 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.337949 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.338533 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.339132 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.339712 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.340150 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.340732 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.341295 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.341873 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.342478 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.343056 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.343619 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.344412 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.345026 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.346210 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.346645 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.347076 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.347656 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.348238 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.348862 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.349463 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.350019 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.350523 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.351154 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.351762 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.352368 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.352827 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.353390 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.353958 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.354524 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.355125 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.355694 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.356138 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.356732 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.357314 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.357883 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.358451 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.358841 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.359397 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.359963 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.360553 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.361111 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.362317 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.362883 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.363474 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.364015 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.364625 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.365208 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.365783 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.366353 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.366935 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.367497 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.368113 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.368740 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.369147 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.369738 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.370327 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.370922 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.371495 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.371950 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.372585 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.373183 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.373760 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.374296 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.374726 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.375310 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.375886 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.376471 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.377134 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.377713 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.378195 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.378724 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.379288 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.379868 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.380455 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.381072 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.381664 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.382265 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.382868 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.383433 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.383984 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.384475 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.385096 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.385671 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.386237 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.386807 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.387380 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.387970 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.388599 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.389218 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.389823 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.390406 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.391020 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.391608 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.392243 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.392891 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.393499 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.393988 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.394545 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.395129 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.395669 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:41:10.396098 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:41:10.488208 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO dbcounter [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Registered counter for database nova_api Aug 29 21:41:10.513703 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:41:10.521265 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG dbcounter [-] [112851] Writer thread running {{(pid=112851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:41:10.586579 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.context [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f4124b42-2c45-4eaf-83bf-04e147b24cbe(cell1) {{(pid=112851) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:41:10.587676 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO dbcounter [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] Registered counter for database nova_api Aug 29 21:41:10.590619 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:10.591103 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:10.592770 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:10.593562 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:10.594021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:10.596672 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:10.598794 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO dbcounter [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Registered counter for database nova_cell0 Aug 29 21:41:10.603760 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO dbcounter [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Registered counter for database nova_cell1 Aug 29 21:41:10.610473 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG oslo_db.sqlalchemy.engines [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:41:10.613469 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:41:10.616737 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:41:10.619073 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG dbcounter [-] [112850] Writer thread running {{(pid=112850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:41:10.622071 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG dbcounter [-] [112851] Writer thread running {{(pid=112851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:41:10.680571 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.context [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f4124b42-2c45-4eaf-83bf-04e147b24cbe(cell1) {{(pid=112850) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:41:10.684770 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG oslo_concurrency.lockutils [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:10.685261 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG oslo_concurrency.lockutils [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:10.686866 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG oslo_concurrency.lockutils [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:10.687636 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG oslo_concurrency.lockutils [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:41:10.688091 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG oslo_concurrency.lockutils [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:41:10.690294 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG oslo_concurrency.lockutils [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:41:10.692532 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO dbcounter [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] Registered counter for database nova_cell0 Aug 29 21:41:10.698768 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO dbcounter [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] Registered counter for database nova_cell1 Aug 29 21:41:10.707829 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG oslo_db.sqlalchemy.engines [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:41:10.710058 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG oslo_db.sqlalchemy.engines [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:41:10.716201 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG dbcounter [-] [112850] Writer thread running {{(pid=112850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:41:10.719287 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG dbcounter [-] [112850] Writer thread running {{(pid=112850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:41:10.773772 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG dbcounter [-] [112851] Writer thread running {{(pid=112851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:41:10.785353 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO dbcounter [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Registered counter for database nova_cell0 Aug 29 21:41:10.792715 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:41:10.798207 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG dbcounter [-] [112851] Writer thread running {{(pid=112851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:41:10.872223 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO dbcounter [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] Registered counter for database nova_cell0 Aug 29 21:41:10.882308 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG oslo_db.sqlalchemy.engines [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:41:10.887490 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG dbcounter [-] [112850] Writer thread running {{(pid=112850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:41:11.250428 dv-cinder-854266-3-smb devstack@n-api.service[112851]: WARNING keystonemiddleware.auth_token [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:41:11.258658 dv-cinder-854266-3-smb devstack@n-api.service[112851]: WARNING keystonemiddleware.auth_token [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:41:11.374032 dv-cinder-854266-3-smb devstack@n-api.service[112850]: WARNING keystonemiddleware.auth_token [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:41:11.382001 dv-cinder-854266-3-smb devstack@n-api.service[112850]: WARNING keystonemiddleware.auth_token [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:41:11.605825 dv-cinder-854266-3-smb devstack@n-api.service[112851]: WARNING keystonemiddleware.auth_token [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:41:11.613089 dv-cinder-854266-3-smb devstack@n-api.service[112851]: WARNING keystonemiddleware.auth_token [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:41:11.618916 dv-cinder-854266-3-smb devstack@n-api.service[112851]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bf4b8ed9c0 pid: 112851 (default app) Aug 29 21:41:11.621335 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:41:11.622656 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] 10.222.0.83 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002051 Aug 29 21:41:11.623111 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 1/1] 10.222.0.83 () {50 vars in 788 bytes} [Mon Aug 29 21:41:11 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:41:11.728016 dv-cinder-854266-3-smb devstack@n-api.service[112850]: WARNING keystonemiddleware.auth_token [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:41:11.734281 dv-cinder-854266-3-smb devstack@n-api.service[112850]: WARNING keystonemiddleware.auth_token [None req-30726c96-b8d8-4624-aad5-a25e26541e1a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:41:11.740143 dv-cinder-854266-3-smb devstack@n-api.service[112850]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bf4b8ed9c0 pid: 112850 (default app) Aug 29 21:42:39.680523 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:39.682050 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Aug 29 21:42:39.682868 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 2/2] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 21:42:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:39.698391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG dbcounter [-] [112850] Writing DB stats nova_api:SELECT=3 {{(pid=112850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:39.698391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG dbcounter [-] [112850] Writing DB stats nova_cell0:SELECT=3 {{(pid=112850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:39.699333 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG dbcounter [-] [112850] Writing DB stats nova_cell1:SELECT=3 {{(pid=112850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:39.700257 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG dbcounter [-] [112850] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:40.666124 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-b0178e88-8c4d-4d54-88c2-437e949007bf admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:40.699846 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-b0178e88-8c4d-4d54-88c2-437e949007bf admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.009531 Aug 29 21:42:40.703885 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 1/3] 10.222.0.83 () {60 vars in 1292 bytes} [Mon Aug 29 21:42:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:43.384681 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:43.385794 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-3c9be02e-0f90-42e0-95c4-4ee8fa919379 None None] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 29 21:42:43.397307 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 3/4] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 21:42:43 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:43.908781 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-d0bc0b7c-9a97-463f-a67a-6cb9af6ce31b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:44.042880 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-d0bc0b7c-9a97-463f-a67a-6cb9af6ce31b admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.650002 Aug 29 21:42:44.043500 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 2/5] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 21:42:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:42:44.061955 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG dbcounter [-] [112851] Writing DB stats nova_api:SELECT=3 {{(pid=112851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:44.065446 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG dbcounter [-] [112851] Writing DB stats nova_cell1:SELECT=3 {{(pid=112851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:44.067184 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG dbcounter [-] [112851] Writing DB stats nova_cell0:SELECT=3 {{(pid=112851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:44.069064 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG dbcounter [-] [112851] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:44.282317 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-ee4acfec-5dc4-4244-af0b-e52588b8cf2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:44.440521 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-ee4acfec-5dc4-4244-af0b-e52588b8cf2a admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.387712 Aug 29 21:42:44.444393 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 4/6] 10.222.0.83 () {64 vars in 1336 bytes} [Mon Aug 29 21:42:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:46.964865 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-d0bc0b7c-9a97-463f-a67a-6cb9af6ce31b admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:46.966204 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-d0bc0b7c-9a97-463f-a67a-6cb9af6ce31b admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001838 Aug 29 21:42:46.966911 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 3/7] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 21:42:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:47.823317 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-6b7183eb-681c-46a2-8eba-37def05444c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "id": "d1", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:47.969393 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-6b7183eb-681c-46a2-8eba-37def05444c5 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.994734 Aug 29 21:42:47.970298 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 5/8] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 21:42:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:42:47.984045 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-93a5d04f-cd04-431f-b267-054151cd0238 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:48.102562 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-93a5d04f-cd04-431f-b267-054151cd0238 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122952 Aug 29 21:42:48.103620 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 4/9] 10.222.0.83 () {64 vars in 1336 bytes} [Mon Aug 29 21:42:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:50.549202 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-6b7183eb-681c-46a2-8eba-37def05444c5 admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:50.550271 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-6b7183eb-681c-46a2-8eba-37def05444c5 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Aug 29 21:42:50.550763 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 6/10] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 21:42:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:51.014286 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-f5b1ac74-0ec9-4456-be72-34b9ce741829 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "ram": 1024, "swap": 0, "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:51.105443 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-f5b1ac74-0ec9-4456-be72-34b9ce741829 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.548152 Aug 29 21:42:51.106400 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 5/11] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 21:42:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:42:51.119862 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-ee025b37-84d5-4a65-b8a8-14161c194c31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:51.195574 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-ee025b37-84d5-4a65-b8a8-14161c194c31 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079643 Aug 29 21:42:51.196167 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 7/12] 10.222.0.83 () {64 vars in 1336 bytes} [Mon Aug 29 21:42:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:42:54.218224 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-f5b1ac74-0ec9-4456-be72-34b9ce741829 admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:54.221046 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-f5b1ac74-0ec9-4456-be72-34b9ce741829 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003765 Aug 29 21:42:54.223234 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 6/13] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 21:42:54 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:42:54.781217 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-fb852b44-3bd0-44f8-8615-ede095095fdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "vcpus": 2, "ram": 2048, "id": "d3"}} {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:54.934801 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-fb852b44-3bd0-44f8-8615-ede095095fdc admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.704131 Aug 29 21:42:54.935410 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 8/14] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 21:42:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:42:54.948465 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-01f78425-6452-4e1e-bbd2-cc0b27f82635 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:55.048921 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-01f78425-6452-4e1e-bbd2-cc0b27f82635 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104022 Aug 29 21:42:55.052944 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 7/15] 10.222.0.83 () {64 vars in 1336 bytes} [Mon Aug 29 21:42:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:42:57.903023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-fb852b44-3bd0-44f8-8615-ede095095fdc admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:42:57.904749 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-fb852b44-3bd0-44f8-8615-ede095095fdc admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 29 21:42:57.904749 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 9/16] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 21:42:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:42:58.601846 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-da35611a-53a1-4619-8ce0-741713518139 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4, "disk": 20, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:58.688938 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-da35611a-53a1-4619-8ce0-741713518139 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.773585 Aug 29 21:42:58.689923 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 8/17] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 21:42:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:42:58.703627 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-451a7dc8-3c53-479f-93a3-f6138eccf054 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:42:58.810520 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-451a7dc8-3c53-479f-93a3-f6138eccf054 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110203 Aug 29 21:42:58.811589 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 10/18] 10.222.0.83 () {64 vars in 1336 bytes} [Mon Aug 29 21:42:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:01.623886 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-da35611a-53a1-4619-8ce0-741713518139 admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:01.625658 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-da35611a-53a1-4619-8ce0-741713518139 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002514 Aug 29 21:43:01.626266 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 9/19] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 21:43:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:43:02.236699 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-ee3e76ef-52de-47a6-af75-71d5501fd8b6 admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:02.290991 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-ee3e76ef-52de-47a6-af75-71d5501fd8b6 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.652516 Aug 29 21:43:02.290991 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 11/20] 10.222.0.83 () {60 vars in 1292 bytes} [Mon Aug 29 21:43:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:43:04.726289 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-da35611a-53a1-4619-8ce0-741713518139 admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:04.727674 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-da35611a-53a1-4619-8ce0-741713518139 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001847 Aug 29 21:43:04.728204 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 10/21] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 21:43:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:43:05.387552 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-74086bb9-36a6-43c0-9007-dc67c246c076 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:05.503315 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-74086bb9-36a6-43c0-9007-dc67c246c076 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.767454 Aug 29 21:43:05.504565 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 12/22] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 21:43:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:43:05.526239 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-25ad37eb-be7c-4d88-b3e9-79c7d7e1381e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:05.660642 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-25ad37eb-be7c-4d88-b3e9-79c7d7e1381e admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141953 Aug 29 21:43:05.662226 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 11/23] 10.222.0.83 () {64 vars in 1333 bytes} [Mon Aug 29 21:43:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:08.628040 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-74086bb9-36a6-43c0-9007-dc67c246c076 admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:08.634530 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-74086bb9-36a6-43c0-9007-dc67c246c076 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002151 Aug 29 21:43:08.634530 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 13/24] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 21:43:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:09.202292 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-53455a9a-9bc4-4a15-84b1-eaf7bb9ee64a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "disk": 20, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:09.284955 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-53455a9a-9bc4-4a15-84b1-eaf7bb9ee64a admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.646352 Aug 29 21:43:09.285857 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 12/25] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 21:43:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:43:09.306245 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-28510f54-d29e-4727-8a77-252ddfd7553c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:09.471070 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-28510f54-d29e-4727-8a77-252ddfd7553c admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.171689 Aug 29 21:43:09.471571 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 14/26] 10.222.0.83 () {64 vars in 1333 bytes} [Mon Aug 29 21:43:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:43:12.136202 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-53455a9a-9bc4-4a15-84b1-eaf7bb9ee64a admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:12.139287 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-53455a9a-9bc4-4a15-84b1-eaf7bb9ee64a admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003675 Aug 29 21:43:12.140064 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 13/27] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 21:43:12 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:12.902619 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-dcbfe9f1-e163-4d3e-b92f-7a8b3d704b4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "disk": 40}} {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:13.029509 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-dcbfe9f1-e163-4d3e-b92f-7a8b3d704b4c admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.877765 Aug 29 21:43:13.031229 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 15/28] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 21:43:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:43:13.050586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-0baa313b-098a-41a8-849e-82f684a681d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:13.057377 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG dbcounter [-] [112850] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:13.183715 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-0baa313b-098a-41a8-849e-82f684a681d4 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.142680 Aug 29 21:43:13.186187 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 14/29] 10.222.0.83 () {64 vars in 1333 bytes} [Mon Aug 29 21:43:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:43:15.863516 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-dcbfe9f1-e163-4d3e-b92f-7a8b3d704b4c admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:15.865538 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-dcbfe9f1-e163-4d3e-b92f-7a8b3d704b4c admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002497 Aug 29 21:43:15.866743 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 16/30] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 21:43:15 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:16.511898 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-62c191aa-a6f2-4e74-bb26-f35dec30d09e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192, "name": "m1.large", "vcpus": 4}} {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:16.623750 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-62c191aa-a6f2-4e74-bb26-f35dec30d09e admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.744272 Aug 29 21:43:16.628551 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 15/31] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 21:43:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:43:16.638229 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-90cbac84-e24a-4923-9417-65019518b2ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:16.647481 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG dbcounter [-] [112851] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=112851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:16.772574 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-90cbac84-e24a-4923-9417-65019518b2ce admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131632 Aug 29 21:43:16.772574 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 17/32] 10.222.0.83 () {64 vars in 1333 bytes} [Mon Aug 29 21:43:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:43:19.608617 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-62c191aa-a6f2-4e74-bb26-f35dec30d09e admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:19.610292 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-62c191aa-a6f2-4e74-bb26-f35dec30d09e admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002271 Aug 29 21:43:19.610887 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 16/33] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 21:43:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:20.194318 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-b7f3e11c-6fac-49b2-8225-3062efd67b6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "id": "5", "disk": 160}} {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:20.331404 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-b7f3e11c-6fac-49b2-8225-3062efd67b6a admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.713085 Aug 29 21:43:20.340635 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 18/34] 10.222.0.83 () {64 vars in 1283 bytes} [Mon Aug 29 21:43:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:43:20.354077 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-a83ee6c4-cf59-4d20-b9b6-ed118f4f1066 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:20.482134 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-a83ee6c4-cf59-4d20-b9b6-ed118f4f1066 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.135678 Aug 29 21:43:20.483354 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 17/35] 10.222.0.83 () {64 vars in 1333 bytes} [Mon Aug 29 21:43:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:43:38.197813 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-b7f3e11c-6fac-49b2-8225-3062efd67b6a admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:38.199186 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-b7f3e11c-6fac-49b2-8225-3062efd67b6a admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001846 Aug 29 21:43:38.199706 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 19/36] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 21:43:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:38.210927 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG dbcounter [-] [112850] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:38.664835 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-63602575-6a28-4141-8284-56a80130da3e admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:38.683268 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-63602575-6a28-4141-8284-56a80130da3e admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.476836 Aug 29 21:43:38.683823 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 18/37] 10.222.0.83 () {60 vars in 1292 bytes} [Mon Aug 29 21:43:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:43:39.777273 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-b7f3e11c-6fac-49b2-8225-3062efd67b6a admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:39.778288 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-b7f3e11c-6fac-49b2-8225-3062efd67b6a admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Aug 29 21:43:39.778692 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 20/38] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 21:43:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:40.376224 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-54a984c8-f9f7-4ac7-b40e-6ea73b3b19bd admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:40.382958 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.wsgi [None req-54a984c8-f9f7-4ac7-b40e-6ea73b3b19bd admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-54a984c8-f9f7-4ac7-b40e-6ea73b3b19bd admin admin] Request method failure captured: Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Accept: application/json Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Accept-Encoding: gzip, deflate Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Connection: keep-alive Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Content-Length: 0 Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Host: 10.222.0.83 Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Openstack-Api-Version: compute 2.90 Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Openstack-System-Scope: None Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: User-Agent: python-novaclient Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Auth-Token: gAAAAABjDTMLSlRsmxYNSbpG3IfOfxuXtchJVM-0STYvDqKB_40xk8LAlUhkCM9lSMKyfB-X9idiLCb0zChPdPw0HIdLMWyYpiA-XfIHMsDjDi-2-d3a6kJHqpsyWyepxZEP75wd5flZnTjm74LS4pC-XcZ-UfQk7jrL7W1Fp8qWqaE0L35JhVY Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Domain-Id: None Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Domain-Name: None Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Identity-Status: Confirmed Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Is-Admin-Project: True Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Project-Domain-Id: default Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Project-Domain-Name: Default Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Project-Id: f1c71f7fdbf248fba40d8efd925d9546 Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Project-Name: admin Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Role: member,reader,admin Aug 29 21:43:40.386391 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Roles: member,reader,admin Aug 29 21:43:40.388245 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:43:40.388245 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Tenant: admin Aug 29 21:43:40.388245 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Tenant-Id: f1c71f7fdbf248fba40d8efd925d9546 Aug 29 21:43:40.388245 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Tenant-Name: admin Aug 29 21:43:40.388245 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-User: admin Aug 29 21:43:40.388245 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-User-Domain-Id: default Aug 29 21:43:40.388245 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-User-Domain-Name: Default Aug 29 21:43:40.388245 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-User-Id: 19faba1f83d443dbaca1d7f5b1b4a452 Aug 29 21:43:40.388245 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-User-Name: admin Aug 29 21:43:40.388245 dv-cinder-854266-3-smb devstack@n-api.service[112850]: method: > Aug 29 21:43:40.388245 dv-cinder-854266-3-smb devstack@n-api.service[112850]: exception: Flavor 42 could not be found. Aug 29 21:43:40.388245 dv-cinder-854266-3-smb devstack@n-api.service[112850]: action_args: {'id': '42'} Aug 29 21:43:40.388245 dv-cinder-854266-3-smb devstack@n-api.service[112850]: {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:43:40.388245 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:43:40.389633 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Aug 29 21:43:40.391663 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-54a984c8-f9f7-4ac7-b40e-6ea73b3b19bd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:43:40.393670 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-54a984c8-f9f7-4ac7-b40e-6ea73b3b19bd admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.465561 Aug 29 21:43:40.393670 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 19/39] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 29 21:43:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 467 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 21:43:40.400622 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-59c599cb-d2ae-402a-ae9d-6e90f887b111 admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:40.405046 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG dbcounter [-] [112851] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=112851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:40.426595 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-59c599cb-d2ae-402a-ae9d-6e90f887b111 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031668 Aug 29 21:43:40.427218 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 21/40] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 29 21:43:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:43:40.437903 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-a4a37234-f40a-4b20-95e6-bfa0618edc14 admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:40.463735 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-a4a37234-f40a-4b20-95e6-bfa0618edc14 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029493 Aug 29 21:43:40.464293 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 20/41] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 29 21:43:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:43:40.474168 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-5896ad8e-f3cc-40ff-af73-3da58285d61d admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:40.480630 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.wsgi [None req-5896ad8e-f3cc-40ff-af73-3da58285d61d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-5896ad8e-f3cc-40ff-af73-3da58285d61d admin admin] Request method failure captured: Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Accept: application/json Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Accept-Encoding: gzip, deflate Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Connection: keep-alive Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Content-Length: 0 Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Host: 10.222.0.83 Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Openstack-Api-Version: compute 2.90 Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Openstack-System-Scope: None Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: User-Agent: python-novaclient Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Auth-Token: gAAAAABjDTMLSlRsmxYNSbpG3IfOfxuXtchJVM-0STYvDqKB_40xk8LAlUhkCM9lSMKyfB-X9idiLCb0zChPdPw0HIdLMWyYpiA-XfIHMsDjDi-2-d3a6kJHqpsyWyepxZEP75wd5flZnTjm74LS4pC-XcZ-UfQk7jrL7W1Fp8qWqaE0L35JhVY Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Domain-Id: None Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Domain-Name: None Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Identity-Status: Confirmed Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Is-Admin-Project: True Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Project-Domain-Id: default Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Project-Domain-Name: Default Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Project-Id: f1c71f7fdbf248fba40d8efd925d9546 Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Project-Name: admin Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Role: member,reader,admin Aug 29 21:43:40.484023 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Roles: member,reader,admin Aug 29 21:43:40.492058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:43:40.492058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Tenant: admin Aug 29 21:43:40.492058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Tenant-Id: f1c71f7fdbf248fba40d8efd925d9546 Aug 29 21:43:40.492058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Tenant-Name: admin Aug 29 21:43:40.492058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-User: admin Aug 29 21:43:40.492058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-User-Domain-Id: default Aug 29 21:43:40.492058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-User-Domain-Name: Default Aug 29 21:43:40.492058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-User-Id: 19faba1f83d443dbaca1d7f5b1b4a452 Aug 29 21:43:40.492058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-User-Name: admin Aug 29 21:43:40.492058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: method: > Aug 29 21:43:40.492058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: exception: Flavor 42 could not be found. Aug 29 21:43:40.492058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: action_args: {'id': '42'} Aug 29 21:43:40.492058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:43:40.492058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:43:40.493650 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Aug 29 21:43:40.495634 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-5896ad8e-f3cc-40ff-af73-3da58285d61d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:43:40.497889 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-5896ad8e-f3cc-40ff-af73-3da58285d61d admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015015 Aug 29 21:43:40.497889 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 22/42] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 29 21:43:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 21:43:41.525795 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-a4a37234-f40a-4b20-95e6-bfa0618edc14 admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:41.526999 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-a4a37234-f40a-4b20-95e6-bfa0618edc14 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Aug 29 21:43:41.527446 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 21/43] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 21:43:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:43:42.133915 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-8e16cdc6-923e-430f-b750-6e7fc130f975 admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:42.140391 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.wsgi [None req-8e16cdc6-923e-430f-b750-6e7fc130f975 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-8e16cdc6-923e-430f-b750-6e7fc130f975 admin admin] Request method failure captured: Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Accept: application/json Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Accept-Encoding: gzip, deflate Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Connection: keep-alive Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Content-Length: 0 Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Host: 10.222.0.83 Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Openstack-Api-Version: compute 2.90 Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Openstack-System-Scope: None Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: User-Agent: python-novaclient Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Auth-Token: gAAAAABjDTMN7BPpmBkF1KB5-5ku923mEZ7ghyMWYGBI1_RnwKD6KuXz3stTw-7OwKU0jWnJ2EN0MK9SHV5lIxIeOgxZdCBsEjF0LQFNGheCLPD4L7cPx7QUxsL0wzIPZ9fqX7AdtvACa9jh37bOlJ8XfvHpWMcutaRnrM16MUGzSjelBpFyiDE Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Domain-Id: None Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Domain-Name: None Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Identity-Status: Confirmed Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Is-Admin-Project: True Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Project-Domain-Id: default Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Project-Domain-Name: Default Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Project-Id: f1c71f7fdbf248fba40d8efd925d9546 Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Project-Name: admin Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Role: member,reader,admin Aug 29 21:43:42.142021 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Roles: member,reader,admin Aug 29 21:43:42.144420 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:43:42.144420 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Tenant: admin Aug 29 21:43:42.144420 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Tenant-Id: f1c71f7fdbf248fba40d8efd925d9546 Aug 29 21:43:42.144420 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Tenant-Name: admin Aug 29 21:43:42.144420 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-User: admin Aug 29 21:43:42.144420 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-User-Domain-Id: default Aug 29 21:43:42.144420 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-User-Domain-Name: Default Aug 29 21:43:42.144420 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-User-Id: 19faba1f83d443dbaca1d7f5b1b4a452 Aug 29 21:43:42.144420 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-User-Name: admin Aug 29 21:43:42.144420 dv-cinder-854266-3-smb devstack@n-api.service[112851]: method: > Aug 29 21:43:42.144420 dv-cinder-854266-3-smb devstack@n-api.service[112851]: exception: Flavor 84 could not be found. Aug 29 21:43:42.144420 dv-cinder-854266-3-smb devstack@n-api.service[112851]: action_args: {'id': '84'} Aug 29 21:43:42.144420 dv-cinder-854266-3-smb devstack@n-api.service[112851]: {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:43:42.144420 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:43:42.146242 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Aug 29 21:43:42.148765 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-8e16cdc6-923e-430f-b750-6e7fc130f975 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:43:42.151065 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-8e16cdc6-923e-430f-b750-6e7fc130f975 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.475736 Aug 29 21:43:42.151065 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 23/44] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 29 21:43:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 477 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:42.160524 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-bb1f42ba-77b9-4ab9-9ebb-99cb9cec294b admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:42.189625 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-bb1f42ba-77b9-4ab9-9ebb-99cb9cec294b admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035781 Aug 29 21:43:42.190644 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 22/45] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 29 21:43:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:43:42.204189 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-e0fd8fd4-f916-45d4-ba44-c06dbb1a94b9 admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:42.220584 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-e0fd8fd4-f916-45d4-ba44-c06dbb1a94b9 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019894 Aug 29 21:43:42.221265 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 24/46] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 29 21:43:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:43:42.232070 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-6cc6847d-e789-4258-9599-2ace850ac567 admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:42.238035 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.wsgi [None req-6cc6847d-e789-4258-9599-2ace850ac567 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-6cc6847d-e789-4258-9599-2ace850ac567 admin admin] Request method failure captured: Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Accept: application/json Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Accept-Encoding: gzip, deflate Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Connection: keep-alive Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Content-Length: 0 Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Host: 10.222.0.83 Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Openstack-Api-Version: compute 2.90 Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Openstack-System-Scope: None Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: User-Agent: python-novaclient Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Auth-Token: gAAAAABjDTMN7BPpmBkF1KB5-5ku923mEZ7ghyMWYGBI1_RnwKD6KuXz3stTw-7OwKU0jWnJ2EN0MK9SHV5lIxIeOgxZdCBsEjF0LQFNGheCLPD4L7cPx7QUxsL0wzIPZ9fqX7AdtvACa9jh37bOlJ8XfvHpWMcutaRnrM16MUGzSjelBpFyiDE Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Domain-Id: None Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Domain-Name: None Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Identity-Status: Confirmed Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Is-Admin-Project: True Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Project-Domain-Id: default Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Project-Domain-Name: Default Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Project-Id: f1c71f7fdbf248fba40d8efd925d9546 Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Project-Name: admin Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Role: member,reader,admin Aug 29 21:43:42.239607 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Roles: member,reader,admin Aug 29 21:43:42.241931 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:43:42.241931 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Tenant: admin Aug 29 21:43:42.241931 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Tenant-Id: f1c71f7fdbf248fba40d8efd925d9546 Aug 29 21:43:42.241931 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Tenant-Name: admin Aug 29 21:43:42.241931 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-User: admin Aug 29 21:43:42.241931 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-User-Domain-Id: default Aug 29 21:43:42.241931 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-User-Domain-Name: Default Aug 29 21:43:42.241931 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-User-Id: 19faba1f83d443dbaca1d7f5b1b4a452 Aug 29 21:43:42.241931 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-User-Name: admin Aug 29 21:43:42.241931 dv-cinder-854266-3-smb devstack@n-api.service[112850]: method: > Aug 29 21:43:42.241931 dv-cinder-854266-3-smb devstack@n-api.service[112850]: exception: Flavor 84 could not be found. Aug 29 21:43:42.241931 dv-cinder-854266-3-smb devstack@n-api.service[112850]: action_args: {'id': '84'} Aug 29 21:43:42.241931 dv-cinder-854266-3-smb devstack@n-api.service[112850]: {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:43:42.241931 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:43:42.243586 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Aug 29 21:43:42.255754 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-6cc6847d-e789-4258-9599-2ace850ac567 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:43:42.258833 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-6cc6847d-e789-4258-9599-2ace850ac567 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012802 Aug 29 21:43:42.258833 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 23/47] 10.222.0.83 () {60 vars in 1190 bytes} [Mon Aug 29 21:43:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:43.264966 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-e0fd8fd4-f916-45d4-ba44-c06dbb1a94b9 admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:43.266038 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-e0fd8fd4-f916-45d4-ba44-c06dbb1a94b9 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Aug 29 21:43:43.266448 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 25/48] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 21:43:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:43.878552 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-59739f1b-98b5-4f0d-ac7e-bbeff26c7498 admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:43.885301 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.wsgi [None req-59739f1b-98b5-4f0d-ac7e-bbeff26c7498 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-59739f1b-98b5-4f0d-ac7e-bbeff26c7498 admin admin] Request method failure captured: Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Accept: application/json Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Accept-Encoding: gzip, deflate Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Connection: keep-alive Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Content-Length: 0 Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Host: 10.222.0.83 Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Openstack-Api-Version: compute 2.90 Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Openstack-System-Scope: None Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: User-Agent: python-novaclient Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Auth-Token: gAAAAABjDTMPSmKU8E1LL445apcQrAVCj7HiPPYLODpET8ESfPhMWpSihDdRpoZ3_gCYTA8dhSYUGqE6tafbRL1qRcFaeItkgXMajWNXij0c5iL5aV4t63JettBPYAL-SF9l-NsL2WnJZhWLfmibGClsac32LGsZjenvJbkWwUcU-xI9YrmCmZA Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Domain-Id: None Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Domain-Name: None Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Identity-Status: Confirmed Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Is-Admin-Project: True Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Project-Domain-Id: default Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Project-Domain-Name: Default Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Project-Id: f1c71f7fdbf248fba40d8efd925d9546 Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Project-Name: admin Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Role: member,reader,admin Aug 29 21:43:43.886853 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Roles: member,reader,admin Aug 29 21:43:43.889368 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:43:43.889368 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Tenant: admin Aug 29 21:43:43.889368 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Tenant-Id: f1c71f7fdbf248fba40d8efd925d9546 Aug 29 21:43:43.889368 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-Tenant-Name: admin Aug 29 21:43:43.889368 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-User: admin Aug 29 21:43:43.889368 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-User-Domain-Id: default Aug 29 21:43:43.889368 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-User-Domain-Name: Default Aug 29 21:43:43.889368 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-User-Id: 19faba1f83d443dbaca1d7f5b1b4a452 Aug 29 21:43:43.889368 dv-cinder-854266-3-smb devstack@n-api.service[112850]: X-User-Name: admin Aug 29 21:43:43.889368 dv-cinder-854266-3-smb devstack@n-api.service[112850]: method: > Aug 29 21:43:43.889368 dv-cinder-854266-3-smb devstack@n-api.service[112850]: exception: Flavor 451 could not be found. Aug 29 21:43:43.889368 dv-cinder-854266-3-smb devstack@n-api.service[112850]: action_args: {'id': '451'} Aug 29 21:43:43.889368 dv-cinder-854266-3-smb devstack@n-api.service[112850]: {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:43:43.889368 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:43:43.890772 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: ERROR nova.api.openstack.wsgi Aug 29 21:43:43.892648 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-59739f1b-98b5-4f0d-ac7e-bbeff26c7498 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:43:43.894816 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-59739f1b-98b5-4f0d-ac7e-bbeff26c7498 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.480516 Aug 29 21:43:43.894816 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 24/49] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 29 21:43:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 482 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:43.900064 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-7f3313c2-b471-48b7-82cb-ec5f6b7a1c3d admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:43.919022 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-7f3313c2-b471-48b7-82cb-ec5f6b7a1c3d admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023902 Aug 29 21:43:43.919600 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 26/50] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 29 21:43:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:43:43.930884 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-55ce2750-65c2-487e-82cf-a8e8690c0f3b admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:43.947302 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-55ce2750-65c2-487e-82cf-a8e8690c0f3b admin admin] 10.222.0.83 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020741 Aug 29 21:43:43.948158 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 25/51] 10.222.0.83 () {60 vars in 1210 bytes} [Mon Aug 29 21:43:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:43:43.958344 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-8d428697-a1ed-481a-bf7a-5b5516d9e722 admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:43.964518 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.wsgi [None req-8d428697-a1ed-481a-bf7a-5b5516d9e722 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-8d428697-a1ed-481a-bf7a-5b5516d9e722 admin admin] Request method failure captured: Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Accept: application/json Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Accept-Encoding: gzip, deflate Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Connection: keep-alive Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Content-Length: 0 Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Host: 10.222.0.83 Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Openstack-Api-Version: compute 2.90 Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Openstack-System-Scope: None Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: User-Agent: python-novaclient Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Auth-Token: gAAAAABjDTMPSmKU8E1LL445apcQrAVCj7HiPPYLODpET8ESfPhMWpSihDdRpoZ3_gCYTA8dhSYUGqE6tafbRL1qRcFaeItkgXMajWNXij0c5iL5aV4t63JettBPYAL-SF9l-NsL2WnJZhWLfmibGClsac32LGsZjenvJbkWwUcU-xI9YrmCmZA Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Domain-Id: None Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Domain-Name: None Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Identity-Status: Confirmed Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Is-Admin-Project: True Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Project-Domain-Id: default Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Project-Domain-Name: Default Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Project-Id: f1c71f7fdbf248fba40d8efd925d9546 Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Project-Name: admin Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Role: member,reader,admin Aug 29 21:43:43.966191 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Roles: member,reader,admin Aug 29 21:43:43.968690 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f1c71f7fdbf248fba40d8efd925d9546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:43:43.968690 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Tenant: admin Aug 29 21:43:43.968690 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Tenant-Id: f1c71f7fdbf248fba40d8efd925d9546 Aug 29 21:43:43.968690 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-Tenant-Name: admin Aug 29 21:43:43.968690 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-User: admin Aug 29 21:43:43.968690 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-User-Domain-Id: default Aug 29 21:43:43.968690 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-User-Domain-Name: Default Aug 29 21:43:43.968690 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-User-Id: 19faba1f83d443dbaca1d7f5b1b4a452 Aug 29 21:43:43.968690 dv-cinder-854266-3-smb devstack@n-api.service[112851]: X-User-Name: admin Aug 29 21:43:43.968690 dv-cinder-854266-3-smb devstack@n-api.service[112851]: method: > Aug 29 21:43:43.968690 dv-cinder-854266-3-smb devstack@n-api.service[112851]: exception: Flavor 451 could not be found. Aug 29 21:43:43.968690 dv-cinder-854266-3-smb devstack@n-api.service[112851]: action_args: {'id': '451'} Aug 29 21:43:43.968690 dv-cinder-854266-3-smb devstack@n-api.service[112851]: {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:43:43.968690 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:43:43.969495 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: ERROR nova.api.openstack.wsgi Aug 29 21:43:43.970827 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-8d428697-a1ed-481a-bf7a-5b5516d9e722 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:43:43.971905 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-8d428697-a1ed-481a-bf7a-5b5516d9e722 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013378 Aug 29 21:43:43.971905 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 27/52] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 29 21:43:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 21:43:45.049568 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-55ce2750-65c2-487e-82cf-a8e8690c0f3b admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:45.050735 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-55ce2750-65c2-487e-82cf-a8e8690c0f3b admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001635 Aug 29 21:43:45.052816 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 26/53] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 21:43:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:43:45.659134 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-634251e5-8090-47b8-900a-e1a87b38c45e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:45.747184 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-634251e5-8090-47b8-900a-e1a87b38c45e admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.553528 Aug 29 21:43:45.747774 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 28/54] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Aug 29 21:43:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:43:46.831124 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-55ce2750-65c2-487e-82cf-a8e8690c0f3b admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:46.832229 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-55ce2750-65c2-487e-82cf-a8e8690c0f3b admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Aug 29 21:43:46.832708 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 27/55] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 21:43:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:47.537119 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-25a3483f-830e-43e1-91e7-51368e8d5edf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:47.643366 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-25a3483f-830e-43e1-91e7-51368e8d5edf admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.664496 Aug 29 21:43:47.643922 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 29/56] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Aug 29 21:43:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:43:48.722295 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-55ce2750-65c2-487e-82cf-a8e8690c0f3b admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:48.723324 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-55ce2750-65c2-487e-82cf-a8e8690c0f3b admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 29 21:43:48.723766 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 28/57] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 21:43:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:43:49.350852 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-10f951f9-4566-4f67-9733-79492d473873 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:49.454685 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-10f951f9-4566-4f67-9733-79492d473873 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.590975 Aug 29 21:43:49.455254 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 30/58] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Aug 29 21:43:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:43:50.502721 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-55ce2750-65c2-487e-82cf-a8e8690c0f3b admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:50.504118 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-55ce2750-65c2-487e-82cf-a8e8690c0f3b admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001800 Aug 29 21:43:50.504731 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 29/59] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 21:43:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:43:51.095881 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-65bee7a1-c1c3-4821-825a-4beb7bda0db1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:43:51.174591 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-65bee7a1-c1c3-4821-825a-4beb7bda0db1 admin admin] 10.222.0.83 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.530778 Aug 29 21:43:51.175143 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 31/60] 10.222.0.83 () {64 vars in 1235 bytes} [Mon Aug 29 21:43:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:43:52.186714 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-55ce2750-65c2-487e-82cf-a8e8690c0f3b admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:52.187916 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-55ce2750-65c2-487e-82cf-a8e8690c0f3b admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Aug 29 21:43:52.188387 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 30/61] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 21:43:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:43:52.756871 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-f4e1e67e-194b-4660-bb75-37b0db62636e admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:43:52.777493 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-f4e1e67e-194b-4660-bb75-37b0db62636e admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.450230 Aug 29 21:43:52.778030 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 32/62] 10.222.0.83 () {60 vars in 1202 bytes} [Mon Aug 29 21:43:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:44:49.421537 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-55ce2750-65c2-487e-82cf-a8e8690c0f3b admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:49.422553 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-55ce2750-65c2-487e-82cf-a8e8690c0f3b admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 29 21:44:49.422968 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 31/63] 10.222.0.83 () {54 vars in 931 bytes} [Mon Aug 29 21:44:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:44:49.434328 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG dbcounter [-] [112851] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:49.845590 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-3bd12628-4dff-4a18-a86d-c6c0499e57b1 admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:49.867058 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-3bd12628-4dff-4a18-a86d-c6c0499e57b1 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.437205 Aug 29 21:44:49.867619 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 33/64] 10.222.0.83 () {60 vars in 1292 bytes} [Mon Aug 29 21:44:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:44:49.891770 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-6b949771-ff32-4ff3-91d7-8efe7fb08970 admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:49.895464 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG dbcounter [-] [112850] Writing DB stats nova_api:SELECT=14 {{(pid=112850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:49.901231 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-6b949771-ff32-4ff3-91d7-8efe7fb08970 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014024 Aug 29 21:44:49.901792 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 32/65] 10.222.0.83 () {60 vars in 1283 bytes} [Mon Aug 29 21:44:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:49.914886 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-62f0dd6a-213b-4589-b2ef-2cc51970b81f admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:49.923136 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-62f0dd6a-213b-4589-b2ef-2cc51970b81f admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012673 Aug 29 21:44:49.923682 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 34/66] 10.222.0.83 () {60 vars in 1286 bytes} [Mon Aug 29 21:44:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:44:49.935839 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-1dadde8b-f20e-4b82-a370-2df571428f22 admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:49.943681 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-1dadde8b-f20e-4b82-a370-2df571428f22 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011611 Aug 29 21:44:49.944260 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 33/67] 10.222.0.83 () {60 vars in 1286 bytes} [Mon Aug 29 21:44:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:44:49.956412 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-fcb191bf-049f-4b4b-ac7c-b7daf73cc381 admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:44:49.965188 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-fcb191bf-049f-4b4b-ac7c-b7daf73cc381 admin admin] 10.222.0.83 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012349 Aug 29 21:44:49.965754 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 35/68] 10.222.0.83 () {60 vars in 1283 bytes} [Mon Aug 29 21:44:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:48:18.555888 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-1dadde8b-f20e-4b82-a370-2df571428f22 admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:48:18.557036 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-1dadde8b-f20e-4b82-a370-2df571428f22 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Aug 29 21:48:18.557447 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 34/69] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 21:48:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:48:18.705230 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG dbcounter [-] [112851] Writing DB stats nova_api:SELECT=6 {{(pid=112851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:18.895670 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-c057f262-1a57-4184-afc1-c3c5ad1724b5 admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:48:18.899468 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-c057f262-1a57-4184-afc1-c3c5ad1724b5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:18.900060 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-c057f262-1a57-4184-afc1-c3c5ad1724b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:18.900520 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-c057f262-1a57-4184-afc1-c3c5ad1724b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:18.901251 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-c057f262-1a57-4184-afc1-c3c5ad1724b5 admin admin] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:18.901700 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-c057f262-1a57-4184-afc1-c3c5ad1724b5 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:18.902120 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-c057f262-1a57-4184-afc1-c3c5ad1724b5 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:18.940029 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-c057f262-1a57-4184-afc1-c3c5ad1724b5 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.236243 Aug 29 21:48:18.940641 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 36/70] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 29 21:48:18 2022] GET /compute/v2.1/os-services => generated 785 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:48:19.821071 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-1dadde8b-f20e-4b82-a370-2df571428f22 admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:48:19.822464 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-1dadde8b-f20e-4b82-a370-2df571428f22 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001869 Aug 29 21:48:19.823049 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 35/71] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 21:48:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:48:20.032864 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-a39245fc-22af-45d7-a1c3-fab9b57f0c12 admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:48:20.038418 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-a39245fc-22af-45d7-a1c3-fab9b57f0c12 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:20.039228 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-a39245fc-22af-45d7-a1c3-fab9b57f0c12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:20.039988 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-a39245fc-22af-45d7-a1c3-fab9b57f0c12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:20.041415 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-a39245fc-22af-45d7-a1c3-fab9b57f0c12 admin admin] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:20.042188 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-a39245fc-22af-45d7-a1c3-fab9b57f0c12 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:20.042950 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-a39245fc-22af-45d7-a1c3-fab9b57f0c12 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:20.080020 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-a39245fc-22af-45d7-a1c3-fab9b57f0c12 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.112348 Aug 29 21:48:20.080960 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 37/72] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 29 21:48:19 2022] GET /compute/v2.1/os-services => generated 785 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:48:31.362652 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-1dadde8b-f20e-4b82-a370-2df571428f22 admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:48:31.366194 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-1dadde8b-f20e-4b82-a370-2df571428f22 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003920 Aug 29 21:48:31.367009 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 36/73] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 21:48:31 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:48:31.518258 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG dbcounter [-] [112851] Writing DB stats nova_cell0:SELECT=4 {{(pid=112851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:31.519482 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG dbcounter [-] [112851] Writing DB stats nova_cell1:SELECT=4 {{(pid=112851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:31.520272 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG dbcounter [-] [112851] Writing DB stats nova_api:SELECT=8 {{(pid=112851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:31.573538 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-d877b0ac-f7e9-4660-8dee-d41f88b5feb1 admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:48:31.576903 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-d877b0ac-f7e9-4660-8dee-d41f88b5feb1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:31.577390 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-d877b0ac-f7e9-4660-8dee-d41f88b5feb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:31.577822 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-d877b0ac-f7e9-4660-8dee-d41f88b5feb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:31.578543 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-d877b0ac-f7e9-4660-8dee-d41f88b5feb1 admin admin] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:31.578993 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-d877b0ac-f7e9-4660-8dee-d41f88b5feb1 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:31.579409 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-d877b0ac-f7e9-4660-8dee-d41f88b5feb1 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:31.607309 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-d877b0ac-f7e9-4660-8dee-d41f88b5feb1 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.093004 Aug 29 21:48:31.607538 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 38/74] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 29 21:48:31 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:48:32.481073 dv-cinder-854266-3-smb devstack@n-api.service[112850]: DEBUG nova.api.openstack.wsgi [None req-1dadde8b-f20e-4b82-a370-2df571428f22 admin admin] Calling method '>' {{(pid=112850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:48:32.482271 dv-cinder-854266-3-smb devstack@n-api.service[112850]: INFO nova.api.openstack.requestlog [None req-1dadde8b-f20e-4b82-a370-2df571428f22 admin admin] 10.222.0.83 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001772 Aug 29 21:48:32.482743 dv-cinder-854266-3-smb devstack@n-api.service[112850]: [pid: 112850|app: 0|req: 37/75] 10.222.0.83 () {56 vars in 1074 bytes} [Mon Aug 29 21:48:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:48:32.740005 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG nova.api.openstack.wsgi [None req-2adfe3c7-b6aa-4ffa-9a6e-b079cea4a484 admin admin] Calling method '>' {{(pid=112851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:48:32.744939 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-2adfe3c7-b6aa-4ffa-9a6e-b079cea4a484 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:32.744939 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-2adfe3c7-b6aa-4ffa-9a6e-b079cea4a484 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:32.744939 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-2adfe3c7-b6aa-4ffa-9a6e-b079cea4a484 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:32.745469 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-2adfe3c7-b6aa-4ffa-9a6e-b079cea4a484 admin admin] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:48:32.745605 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-2adfe3c7-b6aa-4ffa-9a6e-b079cea4a484 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:48:32.746012 dv-cinder-854266-3-smb devstack@n-api.service[112851]: DEBUG oslo_concurrency.lockutils [None req-2adfe3c7-b6aa-4ffa-9a6e-b079cea4a484 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:48:32.769975 dv-cinder-854266-3-smb devstack@n-api.service[112851]: INFO nova.api.openstack.requestlog [None req-2adfe3c7-b6aa-4ffa-9a6e-b079cea4a484 admin admin] 10.222.0.83 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.087552 Aug 29 21:48:32.771047 dv-cinder-854266-3-smb devstack@n-api.service[112851]: [pid: 112851|app: 0|req: 39/76] 10.222.0.83 () {60 vars in 1193 bytes} [Mon Aug 29 21:48:32 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:49:37.305817 dv-cinder-854266-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 21:49:37.306683 dv-cinder-854266-3-smb devstack@n-api.service[112849]: Mon Aug 29 21:49:37 2022 - graceful shutdown triggered... Aug 29 21:49:37.307139 dv-cinder-854266-3-smb devstack@n-api.service[112850]: Gracefully killing worker 1 (pid: 112850)... Aug 29 21:49:37.307638 dv-cinder-854266-3-smb devstack@n-api.service[112851]: Gracefully killing worker 2 (pid: 112851)... Aug 29 21:49:38.307487 dv-cinder-854266-3-smb devstack@n-api.service[112849]: worker 1 buried after 1 seconds Aug 29 21:49:38.307487 dv-cinder-854266-3-smb devstack@n-api.service[112849]: worker 2 buried after 1 seconds Aug 29 21:49:38.307487 dv-cinder-854266-3-smb devstack@n-api.service[112849]: goodbye to uWSGI. Aug 29 21:49:38.309306 dv-cinder-854266-3-smb systemd[1]: devstack@n-api.service: Succeeded. Aug 29 21:49:38.310229 dv-cinder-854266-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 21:49:38.315007 dv-cinder-854266-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 21:49:38.329933 dv-cinder-854266-3-smb devstack@n-api.service[127865]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 21:49:38.334085 dv-cinder-854266-3-smb devstack@n-api.service[127865]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 21:49:38 2022] *** Aug 29 21:49:38.334085 dv-cinder-854266-3-smb devstack@n-api.service[127865]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 21:49:38.334085 dv-cinder-854266-3-smb devstack@n-api.service[127865]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 21:49:38.334085 dv-cinder-854266-3-smb devstack@n-api.service[127865]: nodename: dv-cinder-854266-3-smb Aug 29 21:49:38.334085 dv-cinder-854266-3-smb devstack@n-api.service[127865]: machine: x86_64 Aug 29 21:49:38.334085 dv-cinder-854266-3-smb devstack@n-api.service[127865]: clock source: unix Aug 29 21:49:38.334085 dv-cinder-854266-3-smb devstack@n-api.service[127865]: pcre jit disabled Aug 29 21:49:38.334085 dv-cinder-854266-3-smb devstack@n-api.service[127865]: detected number of CPU cores: 4 Aug 29 21:49:38.334085 dv-cinder-854266-3-smb devstack@n-api.service[127865]: current working directory: / Aug 29 21:49:38.334085 dv-cinder-854266-3-smb devstack@n-api.service[127865]: detected binary path: /usr/bin/uwsgi-core Aug 29 21:49:38.334085 dv-cinder-854266-3-smb devstack@n-api.service[127865]: your processes number limit is 47680 Aug 29 21:49:38.334085 dv-cinder-854266-3-smb devstack@n-api.service[127865]: your memory page size is 4096 bytes Aug 29 21:49:38.336011 dv-cinder-854266-3-smb devstack@n-api.service[127865]: detected max file descriptor number: 2048 Aug 29 21:49:38.336011 dv-cinder-854266-3-smb devstack@n-api.service[127865]: lock engine: pthread robust mutexes Aug 29 21:49:38.336011 dv-cinder-854266-3-smb devstack@n-api.service[127865]: thunder lock: enabled Aug 29 21:49:38.336011 dv-cinder-854266-3-smb devstack@n-api.service[127865]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 21:49:38.336011 dv-cinder-854266-3-smb devstack@n-api.service[127865]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 21:49:38.377811 dv-cinder-854266-3-smb devstack@n-api.service[127865]: Python main interpreter initialized at 0x55c5d83c79c0 Aug 29 21:49:38.377811 dv-cinder-854266-3-smb devstack@n-api.service[127865]: python threads support enabled Aug 29 21:49:38.377811 dv-cinder-854266-3-smb devstack@n-api.service[127865]: your server socket listen backlog is limited to 100 connections Aug 29 21:49:38.377811 dv-cinder-854266-3-smb devstack@n-api.service[127865]: your mercy for graceful operations on workers is 90 seconds Aug 29 21:49:38.378326 dv-cinder-854266-3-smb devstack@n-api.service[127865]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 21:49:38.378326 dv-cinder-854266-3-smb devstack@n-api.service[127865]: *** Operational MODE: preforking *** Aug 29 21:49:38.378574 dv-cinder-854266-3-smb devstack@n-api.service[127865]: *** uWSGI is running in multiple interpreter mode *** Aug 29 21:49:38.378737 dv-cinder-854266-3-smb devstack@n-api.service[127865]: spawned uWSGI master process (pid: 127865) Aug 29 21:49:38.379065 dv-cinder-854266-3-smb systemd[1]: Started Devstack devstack@n-api.service. Aug 29 21:49:38.380137 dv-cinder-854266-3-smb devstack@n-api.service[127865]: spawned uWSGI worker 1 (pid: 127882, cores: 1) Aug 29 21:49:38.380763 dv-cinder-854266-3-smb devstack@n-api.service[127865]: spawned uWSGI worker 2 (pid: 127883, cores: 1) Aug 29 21:49:38.381122 dv-cinder-854266-3-smb devstack@n-api.service[127865]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 21:49:39.091960 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:49:39.095557 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 21:49:40.349073 dv-cinder-854266-3-smb devstack@n-api.service[127882]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:49:40.349073 dv-cinder-854266-3-smb devstack@n-api.service[127882]: from cryptography.utils import int_from_bytes Aug 29 21:49:40.350059 dv-cinder-854266-3-smb devstack@n-api.service[127882]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:49:40.350059 dv-cinder-854266-3-smb devstack@n-api.service[127882]: from cryptography.utils import int_from_bytes Aug 29 21:49:40.593415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:49:40.593415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: from cryptography.utils import int_from_bytes Aug 29 21:49:40.594383 dv-cinder-854266-3-smb devstack@n-api.service[127883]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:49:40.594383 dv-cinder-854266-3-smb devstack@n-api.service[127883]: from cryptography.utils import int_from_bytes Aug 29 21:49:42.991935 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:49:42.992641 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:49:42.992805 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:49:42.993163 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:49:42.993430 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:49:42.993834 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.994170 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.994498 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.994825 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.995327 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.995652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.995983 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.996311 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.996681 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.996956 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.997282 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.997620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854266-3-smb {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.997954 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.998271 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.998598 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.998929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.999243 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.999579 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:42.999898 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.004283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.004283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.004283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.004283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.004283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.004283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.004835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.004835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.004835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.004835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.004835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.004835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854266-3-smb {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.005221 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.005300 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.005794 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.006009 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.006333 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.006653 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.006976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.007338 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.007637 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.007949 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.008278 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.008655 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.008986 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.009304 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.009621 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.009942 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.010286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.010588 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.010899 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.011158 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.011473 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.011802 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.012131 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.012520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.012751 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.014144 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.014144 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.014144 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.014144 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.014613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.014613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.014842 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.015154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.015464 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.015776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.016089 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.016416 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.016768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.017103 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.018173 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.018299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.018720 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.018979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.019299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.019652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.019980 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.020298 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.023069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.023069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.023069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.023069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.023069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.023069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.023069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.023069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032088 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032088 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032088 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032088 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032088 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032088 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032088 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032088 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.032774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035926 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035926 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035926 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035926 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035926 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035926 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035926 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.035926 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.038286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.038286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.038286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.038286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.038286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.038286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.038286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.038286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.039590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.039590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.039590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.039590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.039590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.039590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.039590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.039590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.040692 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.040692 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.040692 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.040692 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.040692 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.040692 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.040692 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.040692 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.041376 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.041376 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.041376 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.041612 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.041813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.042132 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.042448 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.042764 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.043089 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.043412 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.043750 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.044078 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.044459 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.044748 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.045067 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.045390 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.046021 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.046298 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.046615 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.046964 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.047318 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.047638 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.047976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.048303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.048674 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.049001 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.049316 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.049650 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.049999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.050315 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.050647 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.050964 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.051296 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.051617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.051940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.052262 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.052648 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.052904 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.053258 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.053578 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.053911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.054234 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.054556 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.054883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.055199 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.055517 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.055834 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.056147 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.056460 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.056798 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.057123 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.057501 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.057745 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.058886 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.058886 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.058886 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.059513 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.059513 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.059801 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.059954 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.060238 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.060625 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.060906 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.061223 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.061554 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.061879 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.062334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.062580 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.063935 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.063935 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.063935 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.063935 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.065094 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.065094 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.065355 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.065696 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.066018 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.066336 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.066684 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.067020 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.067329 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.067839 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.068176 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.068591 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.068591 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.069071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.069343 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.069582 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.069845 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.070094 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.070412 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.070984 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.071233 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.071483 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.071753 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.072000 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.072827 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.072827 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.073135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.073321 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.073534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.073845 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.074199 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.074541 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.074872 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.075205 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.075544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.075858 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.076184 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.076609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.076870 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.077127 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.077462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.077786 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.079079 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.079079 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.079079 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.079079 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.080885 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.080885 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.080885 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.080885 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.081402 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.081559 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.081873 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.082365 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.082860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.083228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.083509 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.083844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.084160 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.084775 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.085019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.085226 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.085446 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.085820 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.086074 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.086470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.086672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.087047 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.087507 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.087955 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.088224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.088434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.088760 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.089001 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.089541 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.089796 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.090010 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.090325 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.090543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.090871 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.091157 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.091473 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.091787 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.092109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.092424 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.092764 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.093142 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.093395 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.093736 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.094055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.094387 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.094717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.095030 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.095361 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.095703 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.096112 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.096339 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.096971 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.096971 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.097399 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.097610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.097915 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.098239 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.099772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.099772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.099772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.099772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.099772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.100887 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.100887 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.100887 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.101673 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.101673 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.101673 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.102371 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.102371 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.102889 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.102889 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.103449 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.103660 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.103860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.104227 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.104727 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.105054 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.105378 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.105704 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.106027 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.106454 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.106710 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.107099 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.107474 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.107695 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.107949 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.108293 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.108633 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.108910 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.109218 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.109532 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.109929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.110141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.110440 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.110751 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.111108 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.111419 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.111780 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.112095 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.112417 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.112775 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.113086 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.113409 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.113720 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.114028 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.114336 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.114687 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.115007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.115350 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.115684 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.116034 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.116351 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.116691 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.117026 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.117336 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.117648 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.117956 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.118265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.118579 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.118892 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.119209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.119521 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.119840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.120153 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.120463 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.120800 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.121114 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.121434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.121747 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.122060 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.122478 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.122694 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.122979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.123286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.123609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.123912 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.124236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.124569 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.124885 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.125188 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.125506 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.125823 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.126134 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.126475 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.127377 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.127650 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.128803 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.129241 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.129452 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.129755 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.130078 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.130517 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.130742 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.131054 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.131373 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.131688 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.132337 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.132832 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.133155 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.133469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.133839 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.134097 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.134411 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.134725 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.135061 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.135379 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.135693 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.136008 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.136322 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.136818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.137134 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.137510 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.137818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.138229 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.138461 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.138771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.139110 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.139399 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.139710 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.140033 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.140356 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.140728 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.141039 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.141351 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.141683 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.142000 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.142373 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.143198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.143537 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.143867 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.144181 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.144525 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.144844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.145162 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.145341 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:49:43.146032 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:49:43.146200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.146200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.146510 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:49:43.146677 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.146843 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:49:43.147009 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.147183 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:49:43.147353 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.147353 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.147653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.147807 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.147972 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.148124 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.148290 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.148450 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.148721 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.148878 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.149056 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.149221 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.149392 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.149578 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.149736 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.149889 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.150057 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.150221 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.150385 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.150537 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.150691 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.150826 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.150985 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.151120 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.151298 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854266-3-smb {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.151458 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.151609 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.151771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.151923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.152084 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.152272 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.152422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.155538 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.155716 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.155880 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.156047 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.156181 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.156310 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.156310 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.156310 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.156765 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.156911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.156911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.156911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.156911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.156911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.156911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.157662 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.157826 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.158452 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.158600 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.158832 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.158979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.159114 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.159246 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.159379 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.159379 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.159379 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.159379 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.159984 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.159984 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.160254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.160395 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.160565 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.160726 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.160869 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.161014 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.161155 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854266-3-smb {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.161301 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.161449 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.161583 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.161715 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.161843 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.161972 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.162123 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.162259 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.162404 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.162548 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.162680 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.162829 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.162984 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.163129 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.163262 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.163403 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.163537 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.163677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.163827 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.163977 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.164104 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.164104 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.164415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.168720 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.168893 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.168893 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.168893 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.169234 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.169357 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.169487 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.169610 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.169741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.169862 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.169985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.170106 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.170230 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.170356 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.170356 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.170840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.170962 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.171072 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.171197 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.171314 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.171436 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.171548 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.171666 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.171801 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.171919 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.172043 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.172154 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.172272 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.172385 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.172535 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.172670 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.172789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.172921 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.173037 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.173170 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.173280 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.173395 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.173577 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.173715 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.173841 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.178954 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.179202 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.179421 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.179654 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.179882 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.180130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.180401 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.180685 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.180927 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.181186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.181446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.181690 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.181976 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.182192 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.182363 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.182525 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.182684 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.182883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.183087 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.83 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.183251 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.183404 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.83 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.183553 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.183731 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.183961 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.184125 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.184290 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.184450 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.184771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.184936 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.185143 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.185366 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.185583 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.186169 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.186329 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.186482 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.187235 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.187446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.187738 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.187913 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.188300 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.188684 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.189040 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.189040 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.189460 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.189621 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.190064 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.190374 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.190374 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.190374 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.191069 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.191338 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.191598 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.191862 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.192110 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.192364 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.192642 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.193118 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.193320 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.193544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.193791 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.194042 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.194287 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.194544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.194825 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.195096 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.195348 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.195582 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.195826 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.196573 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.196857 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.197114 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.197371 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.197587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.197961 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.198520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.198999 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.199594 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.199861 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.200123 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.200378 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.200685 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.201022 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.201281 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.201535 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.201798 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.202056 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.202323 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.202588 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.202852 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.203112 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.203362 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.203606 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.203872 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.204299 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.204614 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.204967 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.205259 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.205567 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.205851 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.206143 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.206813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.207149 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.207445 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.207732 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.208205 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.210118 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.210430 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.210705 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.210954 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.211219 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.211487 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.211758 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.212028 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.212293 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.212604 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.212872 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.213127 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.213390 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.213667 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.213937 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.214196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.214465 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.214718 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.215217 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.215217 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.215828 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.216102 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.216388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.216767 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.217159 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.217397 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.217622 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.217861 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.218107 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.218463 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.218729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.219230 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.219454 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.219674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.219930 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.221114 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.221354 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.221584 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.221794 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.222023 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.222253 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.222460 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.222638 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.222780 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:49:43.222930 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.223134 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.223363 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.223534 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.223701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.223701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.223983 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.224141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.224290 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.224457 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.224638 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.224795 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.224891 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.224891 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.225130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.225297 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.225402 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.225518 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.225622 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.225622 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.226017 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.226173 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.226327 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.226497 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.226663 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.226827 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.227003 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.227192 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.227348 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.227515 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.227679 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.227842 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.228014 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.228163 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.228316 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.228753 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.228857 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.228984 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.229074 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.229470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.229627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.229783 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.229904 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.230009 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.230166 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.230276 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.230390 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.230478 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.230564 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.230665 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.230761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.230849 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.230935 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.230935 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.231481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.231657 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.231804 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.231908 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.232003 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.232091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.232187 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.232187 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.232347 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.232432 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.232537 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.232638 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.232638 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.232812 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.232905 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.233033 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.233201 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.233352 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.233572 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.233732 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.233881 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.238359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.238589 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.239087 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.239296 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.239723 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.239838 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.239928 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.240005 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.240095 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.240178 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.240325 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.240523 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.240677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.240677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.240997 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.241170 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.241358 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.241889 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.242046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.242214 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.242392 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.242563 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.242718 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.242883 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.242883 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.243161 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.243332 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.243482 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.243659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.243822 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.244027 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.244197 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.244442 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.244706 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.244881 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.245029 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.245180 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.245346 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.245507 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.245649 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.245791 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.245947 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.246098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.246264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.246418 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.246581 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.246740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.246894 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.247061 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.247236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.247394 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.247551 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.247704 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.247872 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.248042 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.248176 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.248325 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.248505 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.248664 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.248664 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.249010 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.249855 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.250016 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.250167 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.250167 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.250476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.250653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.250820 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.250973 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.251128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.251292 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.251460 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.251658 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.251658 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.252367 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.252548 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.252725 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.252896 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.253047 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.253212 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.253366 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.253521 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.253676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.253845 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.253845 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.254103 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.254265 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.254418 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.254573 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.254573 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.254868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.255025 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.255025 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.255343 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.255514 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.255675 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.255838 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.255838 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.255838 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.256254 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.256419 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.256419 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.256419 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.257088 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.257251 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.257251 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.257543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.257698 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.257698 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.257698 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.258126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.258284 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.258284 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.258585 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.258751 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.258905 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.259059 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.259059 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.259689 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.259826 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.259826 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.259826 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.260327 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.260433 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.260433 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.260433 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.260703 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.260806 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.260806 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.260806 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.260806 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.260806 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.261451 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.261563 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.261563 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.261805 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.261958 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.261958 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.262224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.262375 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.262515 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.262663 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.263132 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.263276 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.263411 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.263543 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.263693 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.263834 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.263992 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.264123 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.264249 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.264386 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.264568 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.264696 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.264825 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.264951 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.265094 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.265242 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.265382 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.265509 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.265509 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.265765 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.265900 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.265900 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.265900 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.265900 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.265900 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.266534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.266681 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.266681 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.266681 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.267069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.267253 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.267405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.267541 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.267541 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.267541 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.267909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.268189 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.268189 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.268189 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.268189 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.268189 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.268744 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.268850 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.268938 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.269025 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.269025 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.269025 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.269267 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.269369 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.269369 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.269369 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.269655 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.270380 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.270380 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.270380 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.270380 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.270380 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.270380 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.270380 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.270380 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.271309 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.271467 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.271467 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.271467 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.271870 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.272038 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.272203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.272347 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.272347 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.272629 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.272770 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.272902 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.274249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.274249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.274514 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.274685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.274685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.274685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.275105 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.275254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.275254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.275254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.275254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.275254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.275254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.276087 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.276249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.276249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.276249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.276249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.276249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.276249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.276249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.277488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.277649 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.277649 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.277950 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.278099 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.278099 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.278099 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.278497 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.278661 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.278809 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.278961 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.278961 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.278961 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.279373 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.279530 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.279530 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.279820 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.280768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.280768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.280768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.281171 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.281326 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.281326 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.281607 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.281778 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.281778 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.282192 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.282365 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.282365 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.282365 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.282772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.283451 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.283451 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.283719 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.283879 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.283879 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.283879 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.283879 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.284829 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.284921 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.284921 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.285089 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.285165 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.285165 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.285165 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.285165 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.285538 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.285684 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.285684 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.285684 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.285684 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.286125 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.286256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.286408 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.286573 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.286573 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.286573 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.287040 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.287204 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.287204 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.287443 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.287599 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.287599 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.287599 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.287948 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.288091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.288244 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.288387 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.288828 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.288988 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.289141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.289265 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.289265 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.289416 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.289513 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.289513 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.289710 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.289815 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.289815 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.290067 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.290197 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.290844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.290996 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.290996 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.290996 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.291309 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.291410 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.291410 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.291410 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.291701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.291860 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.291860 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.292155 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.292315 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.292315 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.292616 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.292616 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.292921 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.293084 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.293235 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.293235 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.293235 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.293643 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.293800 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.293800 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.294075 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.294236 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.294236 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.295066 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.295238 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.295238 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.295776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.295931 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.296091 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.296262 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.296262 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.296262 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.296262 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.296925 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.297082 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.297082 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.297386 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.297552 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.297552 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.297552 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.298000 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.298175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.298175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.298175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.299174 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.299340 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.299491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.299658 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.299658 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.299658 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.300030 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.300171 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.300278 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.300741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.300741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.300939 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.301027 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.301027 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.301027 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.301283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.301381 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.301381 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.301381 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.301630 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.301733 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.301733 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.301903 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.301991 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.301991 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.302157 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.302265 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.302363 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.302459 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.302459 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.302634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.302732 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.302732 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.302732 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.302993 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.303089 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.303089 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.303269 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.303359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.303359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.303533 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.303621 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.303621 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.303621 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.303621 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.303955 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.304071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.304071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.304071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.304315 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.304411 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.304411 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.305028 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.305134 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.305134 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.305134 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.305134 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.305134 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.305134 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.305633 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.305734 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.305734 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.305734 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.305734 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.305734 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.306132 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.306227 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.306316 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.306402 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.306402 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.306402 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.306402 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.306702 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.306788 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.307012 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.307130 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.307441 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.307620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.307759 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.308079 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.308183 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.308519 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.308717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.308979 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.309305 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.309495 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.309628 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.309943 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.310104 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.310267 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.310646 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.310988 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.311092 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.311181 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.311277 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.311529 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.311799 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.312086 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.312303 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.312406 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.312673 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.312938 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.313180 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.313403 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.313499 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.313719 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.314041 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.314165 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.314426 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.314675 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.314789 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.315182 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.315300 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.315390 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.315679 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.315835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.315997 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.316331 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.316436 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.316797 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.316933 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.317196 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.317435 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.317543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.317865 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.318051 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.318187 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.318569 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.318682 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.318948 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.319283 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.319376 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.319620 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.319881 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.319976 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.320251 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.320598 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.320729 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.321146 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.321267 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.321372 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.321573 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.321699 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.321897 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.322230 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.322344 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.322540 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.322847 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.322943 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.323184 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.323483 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.323578 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.323958 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.324052 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.324365 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.324613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.324733 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.325162 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.325703 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.325801 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.325877 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.325971 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.326060 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.326264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.326361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.326635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.326843 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.326938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.327383 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.327499 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:49:43.327590 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.327892 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.328211 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.328622 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.328966 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.329285 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.329631 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.330485 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.330825 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.331307 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.331502 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.331835 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.332177 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.332673 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.332861 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.333177 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.333496 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.333809 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.334169 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.334493 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.334827 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.335170 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.335515 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.335885 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.336238 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.336600 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.336935 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.337268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.337612 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.337925 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.338237 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.338560 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.338876 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.339192 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.339510 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.339826 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.340139 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.340452 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.340816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.341199 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.341613 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.341822 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.342142 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.342558 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.342770 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.343081 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.343441 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.343758 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.344107 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.344427 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.344793 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.345124 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.346170 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.346326 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.346652 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.347030 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.347385 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.347787 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.348034 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.348362 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.348715 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.349044 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.349639 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.349982 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.350313 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.350633 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.350959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.351345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.351696 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.351922 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.352245 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.352710 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.352917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.353325 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.353667 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.354052 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.354430 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.354765 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.355092 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.355421 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.355751 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.356127 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.356458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.356799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.357126 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.357511 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.357779 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.358105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.358425 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.358749 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.359073 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.359397 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.359717 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.360038 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.360362 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.360727 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.361119 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.361577 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.361925 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.362213 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.362536 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.363123 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.363446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.363792 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.364134 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.364643 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.364918 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.365250 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.365591 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.365910 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.366224 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.366545 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.366868 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.367180 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.367516 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.367837 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.368198 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.368534 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.368823 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.369410 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.375574 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.375574 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.375574 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.375574 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.375574 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.375574 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.375574 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.375574 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377322 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377322 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377322 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377322 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377322 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377322 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377322 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377322 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377974 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377974 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377974 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377974 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377974 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377974 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377974 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.377974 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.378608 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.378608 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.378608 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.378608 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.378608 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.378970 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.379547 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.379547 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.379845 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.380168 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.380569 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.380917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.381232 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.381547 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.381878 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.382206 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.382796 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.382919 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.383166 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.383564 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.383900 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.384513 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.384865 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.385201 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.385589 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.385923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.386242 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.386561 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.386877 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.387215 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.387537 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.387859 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.388181 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.388571 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.388898 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.389220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.389747 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.389868 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.390202 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.390481 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.390825 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.391122 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.391443 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.391769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.392099 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.394739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.394739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.394739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.394739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.394739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.395241 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.395241 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.395584 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.395908 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.396239 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.396620 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.396967 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.397303 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.397865 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.398077 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.398413 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.398746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.399069 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.399408 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.400148 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.400148 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.400472 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.400803 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.401105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.401540 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.401908 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.402248 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.402567 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.402951 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.403195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.403979 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.403979 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.404298 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.404471 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.404926 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.405094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.405390 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.405705 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.406017 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.406330 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.406647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.406958 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.407271 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.407582 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.408530 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.408851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.409192 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.409519 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.409966 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.410550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.410550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.410905 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.411226 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.411495 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.411842 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.412168 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.412525 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.412847 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.413183 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.413503 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.414324 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.414324 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.414620 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.414789 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.415129 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.415450 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.415772 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.416092 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.416258 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO dbcounter [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] Registered counter for database nova_api Aug 29 21:49:43.416447 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.416754 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.417075 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.417421 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.417759 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.418102 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.418450 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.418780 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.419113 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.419477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.419782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.420237 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.421125 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.421125 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.421466 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.421782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.422076 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.422404 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.422867 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.423040 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.423351 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.423714 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.424568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.424568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.424896 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.425066 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.425393 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.425760 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.426146 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.426490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.426833 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.427160 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.427481 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.427797 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:49:43.428724 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:49:43.443405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_db.sqlalchemy.engines [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127882) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:49:43.451263 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writer thread running {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:49:43.514575 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.context [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f4124b42-2c45-4eaf-83bf-04e147b24cbe(cell1) {{(pid=127882) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:49:43.519574 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:43.520082 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:43.521845 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:43.522669 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:43.523138 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:43.525998 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:43.527882 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO dbcounter [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] Registered counter for database nova_cell0 Aug 29 21:49:43.532813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO dbcounter [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] Registered counter for database nova_cell1 Aug 29 21:49:43.543623 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_db.sqlalchemy.engines [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127882) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:49:43.545772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_db.sqlalchemy.engines [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127882) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:49:43.555624 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writer thread running {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:49:43.556074 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writer thread running {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:49:43.594217 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO dbcounter [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] Registered counter for database nova_api Aug 29 21:49:43.619463 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_db.sqlalchemy.engines [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:49:43.629617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writer thread running {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:49:43.693780 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.context [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f4124b42-2c45-4eaf-83bf-04e147b24cbe(cell1) {{(pid=127883) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 21:49:43.698444 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:43.698942 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:43.700632 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:43.701451 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:49:43.701915 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:49:43.704529 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:49:43.707294 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO dbcounter [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] Registered counter for database nova_cell0 Aug 29 21:49:43.712183 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO dbcounter [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] Registered counter for database nova_cell1 Aug 29 21:49:43.725373 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_db.sqlalchemy.engines [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:49:43.725373 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_db.sqlalchemy.engines [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:49:43.730439 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO dbcounter [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] Registered counter for database nova_cell0 Aug 29 21:49:43.734396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writer thread running {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:49:43.734911 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writer thread running {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:49:43.739903 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_db.sqlalchemy.engines [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127882) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:49:43.746459 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writer thread running {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:49:43.899473 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO dbcounter [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] Registered counter for database nova_cell0 Aug 29 21:49:43.907993 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_db.sqlalchemy.engines [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:49:43.913407 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writer thread running {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:49:44.107957 dv-cinder-854266-3-smb devstack@n-api.service[127882]: WARNING keystonemiddleware.auth_token [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:49:44.116317 dv-cinder-854266-3-smb devstack@n-api.service[127882]: WARNING keystonemiddleware.auth_token [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:49:44.276291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: WARNING keystonemiddleware.auth_token [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:49:44.285213 dv-cinder-854266-3-smb devstack@n-api.service[127883]: WARNING keystonemiddleware.auth_token [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:49:44.467714 dv-cinder-854266-3-smb devstack@n-api.service[127882]: WARNING keystonemiddleware.auth_token [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:49:44.474922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: WARNING keystonemiddleware.auth_token [None req-139f0839-10ee-4222-b15a-d6180ebafff3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:49:44.480714 dv-cinder-854266-3-smb devstack@n-api.service[127882]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c5d83c79c0 pid: 127882 (default app) Aug 29 21:49:44.674197 dv-cinder-854266-3-smb devstack@n-api.service[127883]: WARNING keystonemiddleware.auth_token [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 21:49:44.680695 dv-cinder-854266-3-smb devstack@n-api.service[127883]: WARNING keystonemiddleware.auth_token [None req-22b89628-cd97-47fa-8668-9c04bd049d89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 21:49:44.686496 dv-cinder-854266-3-smb devstack@n-api.service[127883]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c5d83c79c0 pid: 127883 (default app) Aug 29 21:50:24.076688 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=3 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:24.076688 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=3 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:24.078403 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=3 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:24.078503 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=3 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:25.400097 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=3 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:25.403495 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=3 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:25.407678 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=3 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:25.408885 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=3 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:25.865326 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-dc76c64a-bb4c-4520-a884-235faad42b41 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] Action: 'create', calling method: .version_select at 0x7f5041702e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-762547899", "metadata": {"Type": "work"}}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:50:26.433101 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-79679f82-c014-4985-8f39-60c0d8621a56 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Action: 'create', calling method: .version_select at 0x7f50416beee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-780150281"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:50:27.652167 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-dc76c64a-bb4c-4520-a884-235faad42b41 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.593412 Aug 29 21:50:27.654462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 1/1] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 21:50:24 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3597 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 21:50:27.675413 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-66b0f6bd-4a13-4bce-8daf-eab3cc965580 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] Calling method '.version_select at 0x7f5041585ca0>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:28.060245 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-66b0f6bd-4a13-4bce-8daf-eab3cc965580 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/09d70e03-514e-49dd-ba98-2f54e57ba310" status: 200 len: 352 microversion: 2.1 time: 0.393893 Aug 29 21:50:28.061484 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 2/2] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 21:50:27 2022] GET /compute/v2.1/os-volumes/09d70e03-514e-49dd-ba98-2f54e57ba310 => generated 352 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:50:28.125309 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b340d194-20f0-493c-8008-3c7975803ae3 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] Calling method '.version_select at 0x7f504159c3a0>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:28.372750 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b340d194-20f0-493c-8008-3c7975803ae3 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/b1c21759-50a9-4c5e-8cd6-361ff23ebe51" status: 200 len: 350 microversion: 2.1 time: 0.250339 Aug 29 21:50:28.388573 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 3/3] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 21:50:28 2022] GET /compute/v2.1/os-volumes/b1c21759-50a9-4c5e-8cd6-361ff23ebe51 => generated 350 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:50:28.597027 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-79679f82-c014-4985-8f39-60c0d8621a56 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.217152 Aug 29 21:50:28.597027 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 1/4] 10.222.0.83 () {60 vars in 1155 bytes} [Mon Aug 29 21:50:25 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3222 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 21:50:28.626919 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-97420b6a-829f-44fc-b3d5-0c6a4ea80ef3 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Calling method '.version_select at 0x7f504159caf0>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:29.076924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-1f77815e-c0d9-48ab-9f8b-9d549eb25646 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] Calling method '.version_select at 0x7f504153fca0>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:29.352401 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-97420b6a-829f-44fc-b3d5-0c6a4ea80ef3 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b" status: 200 len: 344 microversion: 2.1 time: 0.735193 Aug 29 21:50:29.367671 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 4/5] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 21:50:28 2022] GET /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b => generated 344 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:50:29.602961 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-1f77815e-c0d9-48ab-9f8b-9d549eb25646 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/09d70e03-514e-49dd-ba98-2f54e57ba310" status: 200 len: 353 microversion: 2.1 time: 0.531918 Aug 29 21:50:29.603930 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 2/6] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 21:50:29 2022] GET /compute/v2.1/os-volumes/09d70e03-514e-49dd-ba98-2f54e57ba310 => generated 353 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:50:29.617954 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a8d7def6-b57c-4019-881b-cee0ce18fbf0 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] Calling method '.version_select at 0x7f5041585c10>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:29.791305 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a8d7def6-b57c-4019-881b-cee0ce18fbf0 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/09d70e03-514e-49dd-ba98-2f54e57ba310" status: 200 len: 353 microversion: 2.1 time: 0.178416 Aug 29 21:50:29.793436 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 5/7] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 21:50:29 2022] GET /compute/v2.1/os-volumes/09d70e03-514e-49dd-ba98-2f54e57ba310 => generated 353 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:50:29.813774 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-9842ef9e-a6dd-4b98-b73d-6cc77cfa1435 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] Calling method '.version_select at 0x7f50415500d0>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:30.132442 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-9842ef9e-a6dd-4b98-b73d-6cc77cfa1435 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/09d70e03-514e-49dd-ba98-2f54e57ba310" status: 202 len: 0 microversion: 2.1 time: 0.322777 Aug 29 21:50:30.133968 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 3/8] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 21:50:29 2022] DELETE /compute/v2.1/os-volumes/09d70e03-514e-49dd-ba98-2f54e57ba310 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:50:30.144094 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f6a67e8f-c8f1-4c5e-a49b-400d2f40dfb3 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] Calling method '.version_select at 0x7f504159ca60>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:30.368388 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-46a4f583-6275-4545-947c-acda52ba134d tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Calling method '.version_select at 0x7f5041550790>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:30.385139 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f6a67e8f-c8f1-4c5e-a49b-400d2f40dfb3 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/09d70e03-514e-49dd-ba98-2f54e57ba310" status: 200 len: 352 microversion: 2.1 time: 0.246087 Aug 29 21:50:30.385829 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 6/9] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 21:50:30 2022] GET /compute/v2.1/os-volumes/09d70e03-514e-49dd-ba98-2f54e57ba310 => generated 352 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:50:30.472991 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-46a4f583-6275-4545-947c-acda52ba134d tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b" status: 200 len: 345 microversion: 2.1 time: 0.108856 Aug 29 21:50:30.474134 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 4/10] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 21:50:30 2022] GET /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:50:30.489346 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ac5cd160-cade-4d89-9f57-5c5005396cc0 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Action: 'create', calling method: .version_select at 0x7f504159c3a0>, body: {"snapshot": {"volume_id": "88350700-f6c7-4274-83ba-8d47f5fb113b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1477250978"}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:50:30.965866 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e2a5f618-1480-4a24-a2b9-9949f5e34e43 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] Calling method '.version_select at 0x7f5041550e50>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:31.741424 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ac5cd160-cade-4d89-9f57-5c5005396cc0 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] 10.222.0.83 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.257851 Aug 29 21:50:31.742144 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 7/11] 10.222.0.83 () {60 vars in 1162 bytes} [Mon Aug 29 21:50:30 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:50:31.747631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b58bcd64-6c1a-46a8-97f1-708f83b06da8 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] Calling method '.version_select at 0x7f504159c1f0>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:31.978876 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e2a5f618-1480-4a24-a2b9-9949f5e34e43 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/07040216-5a22-4d61-b10e-7b6cd1417e3d" status: 200 len: 351 microversion: 2.1 time: 1.016789 Aug 29 21:50:31.979571 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 5/12] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 21:50:30 2022] GET /compute/v2.1/os-volumes/07040216-5a22-4d61-b10e-7b6cd1417e3d => generated 351 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:50:31.993042 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-cccf729d-bfe2-48b0-b453-4b8864f873ff tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Calling method '.version_select at 0x7f5041550af0>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:32.040401 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-b58bcd64-6c1a-46a8-97f1-708f83b06da8 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] HTTP exception thrown: Volume 09d70e03-514e-49dd-ba98-2f54e57ba310 could not be found. Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b58bcd64-6c1a-46a8-97f1-708f83b06da8 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] Request method failure captured: Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/os-volumes/09d70e03-514e-49dd-ba98-2f54e57ba310 HTTP/1.1 Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTSf2F27ABVlxPZ5ElamG_YtsdsNlvRITE2YN0JFUqV2Xrlml94OjJrsFpPWnGRXO9JPBMe7-UV9pyrU1JVJ2dKNOx6d7cXhEzBYUAAAu2ZrMEjnhpxqncURX9fS4VtDILS16mAoWdOhr8PnWTC5SmCa8oyeA1Cst1bumMjEx0GtMZE Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 4d6eb6dd6cad46be81629819c22e3cc1 Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-VolumesGetTestJSON-2033825792 Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:50:32.045776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:50:32.047813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4d6eb6dd6cad46be81629819c22e3cc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_4d6eb6dd6cad46be81629819c22e3cc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/4d6eb6dd6cad46be81629819c22e3cc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/4d6eb6dd6cad46be81629819c22e3cc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:50:32.047813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-VolumesGetTestJSON-2033825792 Aug 29 21:50:32.047813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 4d6eb6dd6cad46be81629819c22e3cc1 Aug 29 21:50:32.047813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-VolumesGetTestJSON-2033825792 Aug 29 21:50:32.047813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-VolumesGetTestJSON-2033825792-project Aug 29 21:50:32.047813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:50:32.047813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:50:32.047813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 99285bae990640b597103115522f0ecc Aug 29 21:50:32.047813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-VolumesGetTestJSON-2033825792-project Aug 29 21:50:32.047813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: Aug 29 21:50:32.047813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Volume 09d70e03-514e-49dd-ba98-2f54e57ba310 could not be found. Aug 29 21:50:32.047813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '09d70e03-514e-49dd-ba98-2f54e57ba310'} Aug 29 21:50:32.047813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 09d70e03-514e-49dd-ba98-2f54e57ba310 could not be found. (HTTP 404) (Request-ID: req-687a6bf6-f57a-43d3-abbc-b7b929a11a8c) Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:50:32.050369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:50:32.057200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 09d70e03-514e-49dd-ba98-2f54e57ba310 could not be found. Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 21:50:32.058209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:50:32.059277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 09d70e03-514e-49dd-ba98-2f54e57ba310 could not be found. Aug 29 21:50:32.059277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:32.059277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:50:32.059277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:32.059277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:32.059277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:50:32.059277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:50:32.059277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:50:32.059277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:50:32.059277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 09d70e03-514e-49dd-ba98-2f54e57ba310 could not be found. Aug 29 21:50:32.059277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:32.059277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b58bcd64-6c1a-46a8-97f1-708f83b06da8 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] Returning 404 to user: Volume 09d70e03-514e-49dd-ba98-2f54e57ba310 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:50:32.059277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b58bcd64-6c1a-46a8-97f1-708f83b06da8 tempest-VolumesGetTestJSON-2033825792 tempest-VolumesGetTestJSON-2033825792-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/09d70e03-514e-49dd-ba98-2f54e57ba310" status: 404 len: 109 microversion: 2.1 time: 0.307251 Aug 29 21:50:32.059277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 8/13] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 21:50:31 2022] GET /compute/v2.1/os-volumes/09d70e03-514e-49dd-ba98-2f54e57ba310 => generated 109 bytes in 314 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:50:32.510828 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-cccf729d-bfe2-48b0-b453-4b8864f873ff tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/e88d231e-7622-48d7-8ac9-f34dbad37441" status: 200 len: 287 microversion: 2.1 time: 0.529962 Aug 29 21:50:32.511449 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 6/14] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 21:50:31 2022] GET /compute/v2.1/os-snapshots/e88d231e-7622-48d7-8ac9-f34dbad37441 => generated 287 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:50:32.528659 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-18cc7d33-7172-42d5-bec5-72f321d8a431 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Calling method '.version_select at 0x7f5041f133a0>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:33.061130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-18cc7d33-7172-42d5-bec5-72f321d8a431 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots" status: 200 len: 291 microversion: 2.1 time: 0.523979 Aug 29 21:50:33.061130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 9/15] 10.222.0.83 () {58 vars in 1140 bytes} [Mon Aug 29 21:50:32 2022] GET /compute/v2.1/os-snapshots => generated 291 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:50:33.094772 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4d5ae5bf-5ae6-4ab3-af21-97603199d45f tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Calling method '.version_select at 0x7f50415503a0>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:33.196451 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4d5ae5bf-5ae6-4ab3-af21-97603199d45f tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/e88d231e-7622-48d7-8ac9-f34dbad37441" status: 200 len: 288 microversion: 2.1 time: 0.116136 Aug 29 21:50:33.209375 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 7/16] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 21:50:33 2022] GET /compute/v2.1/os-snapshots/e88d231e-7622-48d7-8ac9-f34dbad37441 => generated 288 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:50:33.213564 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a39c3cc3-7282-4af4-a737-ae7c6ae37ea8 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Calling method '.version_select at 0x7f50415090d0>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:33.533513 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a39c3cc3-7282-4af4-a737-ae7c6ae37ea8 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] 10.222.0.83 "DELETE /compute/v2.1/os-snapshots/e88d231e-7622-48d7-8ac9-f34dbad37441" status: 202 len: 0 microversion: 2.1 time: 0.323658 Aug 29 21:50:33.534506 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 10/17] 10.222.0.83 () {58 vars in 1254 bytes} [Mon Aug 29 21:50:33 2022] DELETE /compute/v2.1/os-snapshots/e88d231e-7622-48d7-8ac9-f34dbad37441 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:50:33.551520 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-eda11b48-2df9-408f-9494-dc1ee5c6ce24 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Calling method '.version_select at 0x7f504153fdc0>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:33.649032 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-eda11b48-2df9-408f-9494-dc1ee5c6ce24 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/e88d231e-7622-48d7-8ac9-f34dbad37441" status: 200 len: 287 microversion: 2.1 time: 0.107012 Aug 29 21:50:33.650079 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 8/18] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 21:50:33 2022] GET /compute/v2.1/os-snapshots/e88d231e-7622-48d7-8ac9-f34dbad37441 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:50:34.677961 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-09ab88a6-5779-4f33-857c-431efef2756d tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Calling method '.version_select at 0x7f5041509820>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:34.709369 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-3a9b0b36-ace2-4875-8fdc-627caaf01f1e tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] Calling method '.version_select at 0x7f50416bee50>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:34.784465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-09ab88a6-5779-4f33-857c-431efef2756d tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] HTTP exception thrown: Snapshot e88d231e-7622-48d7-8ac9-f34dbad37441 could not be found. Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-09ab88a6-5779-4f33-857c-431efef2756d tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Request method failure captured: Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/os-snapshots/e88d231e-7622-48d7-8ac9-f34dbad37441 HTTP/1.1 Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTShb7WD734a2GfPVUx_7KNlyxmcozTWdE6Ev75tNZSbezxcW8qfz8m1hrkLDhrVQa00fyoaZEO-7L0MMKswOhvHJAO4FR06pOKz8EzkoVaQyz7oeqG_S6_MjbcjjHh94XrjVpQId02uQI3fVniVR8jw6CmqfK_JEDJ182yfRaGK5oU Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 74ad24fefb36441aa078c6b9a9e3e4e8 Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1798131986 Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:50:34.789286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:50:34.790652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:50:34.790652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1798131986 Aug 29 21:50:34.790652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 74ad24fefb36441aa078c6b9a9e3e4e8 Aug 29 21:50:34.790652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1798131986 Aug 29 21:50:34.790652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-VolumesSnapshotsTestJSON-1798131986-project Aug 29 21:50:34.790652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:50:34.790652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:50:34.790652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: f7a967836b8e463ba12fd1b5e630efb5 Aug 29 21:50:34.790652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1798131986-project Aug 29 21:50:34.790652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: Aug 29 21:50:34.790652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Snapshot e88d231e-7622-48d7-8ac9-f34dbad37441 could not be found. Aug 29 21:50:34.790652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': 'e88d231e-7622-48d7-8ac9-f34dbad37441'} Aug 29 21:50:34.790652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e88d231e-7622-48d7-8ac9-f34dbad37441 could not be found. (HTTP 404) (Request-ID: req-fe1cb8eb-f63a-406a-be6a-e9adcc6261ac) Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:34.791488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:50:34.799672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e88d231e-7622-48d7-8ac9-f34dbad37441 could not be found. Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 21:50:34.801431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:50:34.802733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e88d231e-7622-48d7-8ac9-f34dbad37441 could not be found. Aug 29 21:50:34.802733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:34.802733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:50:34.802733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:34.802733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:34.802733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:50:34.802733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:50:34.802733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:50:34.802733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:50:34.802733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e88d231e-7622-48d7-8ac9-f34dbad37441 could not be found. Aug 29 21:50:34.802733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:34.802733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-09ab88a6-5779-4f33-857c-431efef2756d tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Returning 404 to user: Snapshot e88d231e-7622-48d7-8ac9-f34dbad37441 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:50:34.802733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-09ab88a6-5779-4f33-857c-431efef2756d tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] 10.222.0.83 "GET /compute/v2.1/os-snapshots/e88d231e-7622-48d7-8ac9-f34dbad37441" status: 404 len: 111 microversion: 2.1 time: 0.127502 Aug 29 21:50:34.804064 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 11/19] 10.222.0.83 () {58 vars in 1251 bytes} [Mon Aug 29 21:50:34 2022] GET /compute/v2.1/os-snapshots/e88d231e-7622-48d7-8ac9-f34dbad37441 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:50:34.807777 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-23a6f383-45ec-4312-82d6-3c8b711a9f71 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Calling method '.version_select at 0x7f5041509a60>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:35.216360 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-3a9b0b36-ace2-4875-8fdc-627caaf01f1e tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/bd18cd87-f8c5-4a29-b280-9bdea4908333" status: 200 len: 351 microversion: 2.1 time: 0.518610 Aug 29 21:50:35.217344 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 9/20] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 21:50:34 2022] GET /compute/v2.1/os-volumes/bd18cd87-f8c5-4a29-b280-9bdea4908333 => generated 351 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:50:35.231077 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e7f3baaf-775e-4df3-acd4-49ecfbeda89a tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] Calling method '.version_select at 0x7f50415505e0>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:35.520835 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e7f3baaf-775e-4df3-acd4-49ecfbeda89a tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.293892 Aug 29 21:50:35.521913 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 10/21] 10.222.0.83 () {58 vars in 1134 bytes} [Mon Aug 29 21:50:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:50:35.546093 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-52d8addc-8526-46e4-b326-f87312a8cf20 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] Calling method '.version_select at 0x7f50415565e0>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:35.633957 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-23a6f383-45ec-4312-82d6-3c8b711a9f71 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b" status: 202 len: 0 microversion: 2.1 time: 0.832442 Aug 29 21:50:35.638484 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 12/22] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 21:50:34 2022] DELETE /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b => generated 0 bytes in 838 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:50:35.648746 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f1ae6569-4674-48aa-a150-21eda4543d84 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Calling method '.version_select at 0x7f50415264c0>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:35.885273 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-52d8addc-8526-46e4-b326-f87312a8cf20 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.351679 Aug 29 21:50:35.886154 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 11/23] 10.222.0.83 () {58 vars in 1149 bytes} [Mon Aug 29 21:50:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:50:35.903603 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-1fd70550-bf2b-4f2d-a83d-cdb0855eba92 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] Calling method '.version_select at 0x7f5041556a60>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:35.981129 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f1ae6569-4674-48aa-a150-21eda4543d84 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b" status: 200 len: 344 microversion: 2.1 time: 0.338883 Aug 29 21:50:35.981968 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 13/24] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 21:50:35 2022] GET /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b => generated 344 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:50:36.224304 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-1fd70550-bf2b-4f2d-a83d-cdb0855eba92 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] 10.222.0.83 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.326072 Aug 29 21:50:36.225010 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 12/25] 10.222.0.83 () {58 vars in 1134 bytes} [Mon Aug 29 21:50:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:50:36.247068 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f4555f47-de3d-47a8-a0f4-12a50cf002e4 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] Calling method '.version_select at 0x7f5041526b80>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:36.486760 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f4555f47-de3d-47a8-a0f4-12a50cf002e4 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] 10.222.0.83 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.245201 Aug 29 21:50:36.488232 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 14/26] 10.222.0.83 () {58 vars in 1167 bytes} [Mon Aug 29 21:50:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:50:36.506292 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-c84c6583-a680-4792-b68a-e929e9553fdb tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] Calling method '.version_select at 0x7f5041550c10>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:36.723714 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-c84c6583-a680-4792-b68a-e929e9553fdb tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.224341 Aug 29 21:50:36.734328 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 13/27] 10.222.0.83 () {58 vars in 1170 bytes} [Mon Aug 29 21:50:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:50:36.739638 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-88f93338-81ee-488b-bcfd-020a233932e1 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] Calling method '.version_select at 0x7f5041f13040>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:37.002786 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-88f93338-81ee-488b-bcfd-020a233932e1 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.267715 Aug 29 21:50:37.004991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 15/28] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 21:50:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:50:37.030116 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-86e7c109-115c-42aa-bc23-82dde598c0f6 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Calling method '.version_select at 0x7f504159c160>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:37.155538 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-86e7c109-115c-42aa-bc23-82dde598c0f6 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] HTTP exception thrown: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-86e7c109-115c-42aa-bc23-82dde598c0f6 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Request method failure captured: Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b HTTP/1.1 Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTShb7WD734a2GfPVUx_7KNlyxmcozTWdE6Ev75tNZSbezxcW8qfz8m1hrkLDhrVQa00fyoaZEO-7L0MMKswOhvHJAO4FR06pOKz8EzkoVaQyz7oeqG_S6_MjbcjjHh94XrjVpQId02uQI3fVniVR8jw6CmqfK_JEDJ182yfRaGK5oU Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 74ad24fefb36441aa078c6b9a9e3e4e8 Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1798131986 Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:50:37.159308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:50:37.160422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:50:37.160422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1798131986 Aug 29 21:50:37.160422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 74ad24fefb36441aa078c6b9a9e3e4e8 Aug 29 21:50:37.160422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1798131986 Aug 29 21:50:37.160422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-VolumesSnapshotsTestJSON-1798131986-project Aug 29 21:50:37.160422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:50:37.160422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:50:37.160422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: f7a967836b8e463ba12fd1b5e630efb5 Aug 29 21:50:37.160422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1798131986-project Aug 29 21:50:37.160422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: Aug 29 21:50:37.160422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. Aug 29 21:50:37.160422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '88350700-f6c7-4274-83ba-8d47f5fb113b'} Aug 29 21:50:37.160422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. (HTTP 404) (Request-ID: req-fc479c2a-d047-42c7-845a-674f2b6bb36d) Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:50:37.161166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:50:37.162113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 21:50:37.163128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:50:37.164006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. Aug 29 21:50:37.164006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:37.164006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:50:37.164006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:37.164006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:37.164006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:50:37.164006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:50:37.164006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:50:37.164006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:50:37.164006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. Aug 29 21:50:37.164006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:37.164006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-86e7c109-115c-42aa-bc23-82dde598c0f6 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Returning 404 to user: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:50:37.164006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-86e7c109-115c-42aa-bc23-82dde598c0f6 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b" status: 404 len: 109 microversion: 2.1 time: 0.154996 Aug 29 21:50:37.164766 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 16/29] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 21:50:37 2022] GET /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b => generated 109 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:50:37.175033 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6f43d66c-5408-4d5e-9d11-40179cdc5fb6 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] Calling method '.version_select at 0x7f5041526e50>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:37.389798 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-6f43d66c-5408-4d5e-9d11-40179cdc5fb6 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.224506 Aug 29 21:50:37.392193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 17/30] 10.222.0.83 () {58 vars in 1188 bytes} [Mon Aug 29 21:50:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:50:37.410228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a690cbfe-203c-4fa2-9b35-e5aaca505883 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Calling method '.version_select at 0x7f504159c040>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:37.463267 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-a690cbfe-203c-4fa2-9b35-e5aaca505883 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] HTTP exception thrown: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a690cbfe-203c-4fa2-9b35-e5aaca505883 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Request method failure captured: Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: DELETE /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b HTTP/1.1 Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTShb7WD734a2GfPVUx_7KNlyxmcozTWdE6Ev75tNZSbezxcW8qfz8m1hrkLDhrVQa00fyoaZEO-7L0MMKswOhvHJAO4FR06pOKz8EzkoVaQyz7oeqG_S6_MjbcjjHh94XrjVpQId02uQI3fVniVR8jw6CmqfK_JEDJ182yfRaGK5oU Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 74ad24fefb36441aa078c6b9a9e3e4e8 Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1798131986 Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:50:37.465462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:50:37.466613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:50:37.466613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1798131986 Aug 29 21:50:37.466613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 74ad24fefb36441aa078c6b9a9e3e4e8 Aug 29 21:50:37.466613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1798131986 Aug 29 21:50:37.466613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-VolumesSnapshotsTestJSON-1798131986-project Aug 29 21:50:37.466613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:50:37.466613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:50:37.466613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: f7a967836b8e463ba12fd1b5e630efb5 Aug 29 21:50:37.466613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1798131986-project Aug 29 21:50:37.466613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: Aug 29 21:50:37.466613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. Aug 29 21:50:37.466613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '88350700-f6c7-4274-83ba-8d47f5fb113b'} Aug 29 21:50:37.466613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. (HTTP 404) (Request-ID: req-fa94bab1-eedd-4f0b-b4e4-9e2cb11b025c) Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:50:37.467240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 21:50:37.468774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 21:50:37.475393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:50:37.476285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. Aug 29 21:50:37.476285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:37.476285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:50:37.476285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:37.476285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:37.476285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:50:37.476285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:50:37.476285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:50:37.476285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:50:37.476285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. Aug 29 21:50:37.476285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:37.476285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a690cbfe-203c-4fa2-9b35-e5aaca505883 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Returning 404 to user: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:50:37.476285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a690cbfe-203c-4fa2-9b35-e5aaca505883 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b" status: 404 len: 109 microversion: 2.1 time: 0.075078 Aug 29 21:50:37.476285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 18/31] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 21:50:37 2022] DELETE /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:50:37.477382 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-3825c8dd-c73d-4351-8da3-7f4ff1ee6b50 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] Calling method '.version_select at 0x7f50415099d0>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:37.700702 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-3825c8dd-c73d-4351-8da3-7f4ff1ee6b50 tempest-VolumesTestJSON-1310702032 tempest-VolumesTestJSON-1310702032-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.228911 Aug 29 21:50:37.704919 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 19/32] 10.222.0.83 () {58 vars in 1155 bytes} [Mon Aug 29 21:50:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:50:37.724997 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-995484f2-d1c4-477e-890c-3eaaeb42a285 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Action: 'create', calling method: .version_select at 0x7f50415631f0>, body: {"keypair": {"name": "tempest-keypair-329749883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8VyvCw5ZIv/8Ey4LsE2eNRfjGXnkXLJgJgvWnBTUHxU/cI4QvKfRl1AKuzr1Rwv2poD/v6Bfi0ZmxT5QYn+oC2YY/pna2M2BonJ76O1YnRUJOhSIe2RMuwfwn7pUwLTw=="}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:50:37.736080 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-636deec5-6a4b-40c0-9733-274904c9ae96 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Calling method '.version_select at 0x7f5041509a60>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:37.864241 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-995484f2-d1c4-477e-890c-3eaaeb42a285 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Getting quotas for project 754af1c2cd154e91ad9ecbee3ce04d0d. Resources: {'key_pairs'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:50:37.878600 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-995484f2-d1c4-477e-890c-3eaaeb42a285 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Getting quotas for user fb465b4782514e7d8e75a7dc14c0a1e7 and project 754af1c2cd154e91ad9ecbee3ce04d0d. Resources: {'key_pairs'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:50:38.127155 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-995484f2-d1c4-477e-890c-3eaaeb42a285 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.142391 Aug 29 21:50:38.128220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 14/33] 10.222.0.83 () {62 vars in 1200 bytes} [Mon Aug 29 21:50:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1144 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 29 21:50:38.190431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-636deec5-6a4b-40c0-9733-274904c9ae96 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] HTTP exception thrown: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-636deec5-6a4b-40c0-9733-274904c9ae96 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Request method failure captured: Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b HTTP/1.1 Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTShb7WD734a2GfPVUx_7KNlyxmcozTWdE6Ev75tNZSbezxcW8qfz8m1hrkLDhrVQa00fyoaZEO-7L0MMKswOhvHJAO4FR06pOKz8EzkoVaQyz7oeqG_S6_MjbcjjHh94XrjVpQId02uQI3fVniVR8jw6CmqfK_JEDJ182yfRaGK5oU Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 74ad24fefb36441aa078c6b9a9e3e4e8 Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1798131986 Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:50:38.206085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:50:38.207183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/74ad24fefb36441aa078c6b9a9e3e4e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:50:38.207183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1798131986 Aug 29 21:50:38.207183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 74ad24fefb36441aa078c6b9a9e3e4e8 Aug 29 21:50:38.207183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1798131986 Aug 29 21:50:38.207183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-VolumesSnapshotsTestJSON-1798131986-project Aug 29 21:50:38.207183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:50:38.207183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:50:38.207183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: f7a967836b8e463ba12fd1b5e630efb5 Aug 29 21:50:38.207183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1798131986-project Aug 29 21:50:38.207183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: Aug 29 21:50:38.207183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. Aug 29 21:50:38.207183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '88350700-f6c7-4274-83ba-8d47f5fb113b'} Aug 29 21:50:38.207183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. (HTTP 404) (Request-ID: req-547302af-a8c3-4af6-b3ab-59031dc53a73) Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:50:38.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 21:50:38.208814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 21:50:38.209740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:50:38.210631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. Aug 29 21:50:38.210631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:38.210631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:50:38.210631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:38.210631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:50:38.210631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:50:38.210631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:50:38.210631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:50:38.210631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:50:38.210631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. Aug 29 21:50:38.210631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:50:38.210631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-636deec5-6a4b-40c0-9733-274904c9ae96 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] Returning 404 to user: Volume 88350700-f6c7-4274-83ba-8d47f5fb113b could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:50:38.210631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-636deec5-6a4b-40c0-9733-274904c9ae96 tempest-VolumesSnapshotsTestJSON-1798131986 tempest-VolumesSnapshotsTestJSON-1798131986-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b" status: 404 len: 109 microversion: 2.1 time: 0.495457 Aug 29 21:50:38.210631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 20/34] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 21:50:37 2022] GET /compute/v2.1/os-volumes/88350700-f6c7-4274-83ba-8d47f5fb113b => generated 109 bytes in 501 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:50:41.922592 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5e4ff23f-72fb-43ba-a52a-0eabb6af6a3a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Action: 'create', calling method: .version_select at 0x7f504159c4c0>, body: {"keypair": {"name": "tempest-keypair-84336297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOc9hPT60QJvMTxjB1Tr/cC9pVZLqQTb/yf0AzolJWtaSMUQm86KEzuEMWO0a1kQOPsCZYJCG86OJIdqEJ8fTSq1DAXgY/smVrXmCtZ0ncnnCMHg/Yrp1GFdJMIYDU+Dw=="}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:50:41.949280 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1804276345", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "networks": [{"uuid": "748fe750-ba39-4468-9a77-20b3fe0a783a"}]}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:50:42.118082 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-5e4ff23f-72fb-43ba-a52a-0eabb6af6a3a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Getting quotas for project d45ce54651ad4326bccecbeea8b5b084. Resources: {'key_pairs'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:50:42.133735 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-5e4ff23f-72fb-43ba-a52a-0eabb6af6a3a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Getting quotas for user ed8ef9f9eafd4248bae86f0e8ec72731 and project d45ce54651ad4326bccecbeea8b5b084. Resources: {'key_pairs'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:50:42.325039 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.network.neutron [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] validate_networks() for [('748fe750-ba39-4468-9a77-20b3fe0a783a', None, None, None, None, None)] {{(pid=127883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:50:42.408544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5e4ff23f-72fb-43ba-a52a-0eabb6af6a3a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.722195 Aug 29 21:50:42.408544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 21/35] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 21:50:41 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:50:44.907147 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1503527552", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44c6fe50-f230-4cd8-8b13-2db7bc2daddd"}], "security_groups": [{"name": "tempest-securitygroup--125269326"}], "key_name": "tempest-keypair-329749883", "user_data": "}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:50:45.119250 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Flavor limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:50:45.120326 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Image limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:50:45.121050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Flavor pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:50:45.121654 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Image pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:50:45.122208 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:50:45.144670 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:45.145350 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:45.145945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:45.147065 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:45.147805 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:45.148442 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:45.183939 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.network.neutron [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] validate_networks() for [('44c6fe50-f230-4cd8-8b13-2db7bc2daddd', None, None, None, None, None)] {{(pid=127882) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:50:45.189207 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Getting quotas for project be7f29d3c82242b7bdc4ead9fa6f4afc. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:50:45.194993 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Getting quotas for user 2698bc78f2e3432faf8fd2a1d16d3b3a and project be7f29d3c82242b7bdc4ead9fa6f4afc. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:50:45.215577 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Going to run 1 instances... {{(pid=127883) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:50:45.220442 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:50:45.483913 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-84994b6b-5298-462b-92f6-aa0ceaa0f188 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.194565 Aug 29 21:50:45.496003 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 15/36] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:50:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 4209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:50:45.503620 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-96dcadcf-72ec-48dd-8254-bc94e49c7e99 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:45.512348 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-96dcadcf-72ec-48dd-8254-bc94e49c7e99 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:45.849636 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-96dcadcf-72ec-48dd-8254-bc94e49c7e99 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:45.881929 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-96dcadcf-72ec-48dd-8254-bc94e49c7e99 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1215 microversion: 2.1 time: 0.382753 Aug 29 21:50:45.886020 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 16/37] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:45 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1215 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:50:46.930290 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7a199029-c5fb-47d2-a1ac-600535a9315a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:46.931565 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7a199029-c5fb-47d2-a1ac-600535a9315a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:47.318194 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7a199029-c5fb-47d2-a1ac-600535a9315a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:47.328347 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7a199029-c5fb-47d2-a1ac-600535a9315a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1215 microversion: 2.1 time: 0.403051 Aug 29 21:50:47.340879 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 17/38] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:46 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1215 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:50:47.812255 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Flavor limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:50:47.814195 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Image limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:50:47.815667 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Flavor pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:50:47.816610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Image pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:50:47.818940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:50:47.873023 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:47.873529 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:47.875628 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:47.877005 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:47.877651 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:47.878289 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:47.922997 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Getting quotas for project 754af1c2cd154e91ad9ecbee3ce04d0d. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:50:47.928839 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Getting quotas for user fb465b4782514e7d8e75a7dc14c0a1e7 and project 754af1c2cd154e91ad9ecbee3ce04d0d. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:50:47.978700 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Going to run 1 instances... {{(pid=127882) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:50:47.982377 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127882) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:50:48.243182 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-7adb73ce-467e-4ae0-92cd-2c08fce362c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.342303 Aug 29 21:50:48.249157 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 22/39] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 21:50:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 3349 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 21:50:48.258589 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-bcaaccb6-5dbe-453b-9796-8ef65d6456c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:48.260964 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-bcaaccb6-5dbe-453b-9796-8ef65d6456c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:48.373340 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-09efbb1d-9233-454f-b576-84b5954ebdd6 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:48.374284 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-09efbb1d-9233-454f-b576-84b5954ebdd6 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:48.577358 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-09efbb1d-9233-454f-b576-84b5954ebdd6 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:48.597658 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-09efbb1d-9233-454f-b576-84b5954ebdd6 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1215 microversion: 2.1 time: 0.237024 Aug 29 21:50:48.598470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 23/40] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:48 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:50:48.638655 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-bcaaccb6-5dbe-453b-9796-8ef65d6456c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:48.651346 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-bcaaccb6-5dbe-453b-9796-8ef65d6456c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:48.659682 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-bcaaccb6-5dbe-453b-9796-8ef65d6456c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:48.662692 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-bcaaccb6-5dbe-453b-9796-8ef65d6456c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1281 microversion: 2.20 time: 0.408121 Aug 29 21:50:48.689699 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 18/41] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:50:48 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1281 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:50:49.581906 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-244318987", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41d7d7c2-6fcb-4be2-951b-fef278b3958e"}], "security_groups": [{"name": "tempest-securitygroup--1177159781"}], "key_name": "tempest-keypair-84336297", "user_data": "}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:50:49.622758 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d527784f-db07-4b83-9df1-7b99480684e5 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:49.632300 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d527784f-db07-4b83-9df1-7b99480684e5 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:49.654361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d527784f-db07-4b83-9df1-7b99480684e5 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:49.657189 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d527784f-db07-4b83-9df1-7b99480684e5 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:49.657772 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d527784f-db07-4b83-9df1-7b99480684e5 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:49.661870 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d527784f-db07-4b83-9df1-7b99480684e5 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:49.669399 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d527784f-db07-4b83-9df1-7b99480684e5 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:49.675822 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d527784f-db07-4b83-9df1-7b99480684e5 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:49.860150 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.network.neutron [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] validate_networks() for [('41d7d7c2-6fcb-4be2-951b-fef278b3958e', None, None, None, None, None)] {{(pid=127882) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:50:49.897109 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d527784f-db07-4b83-9df1-7b99480684e5 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:49.912790 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d527784f-db07-4b83-9df1-7b99480684e5 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1219 microversion: 2.1 time: 0.295497 Aug 29 21:50:49.914107 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 19/42] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:49 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1219 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:50:49.919519 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8d46b914-f9ea-42af-b9da-cfd2024d5871 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:49.920792 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-8d46b914-f9ea-42af-b9da-cfd2024d5871 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:49.992697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-8d46b914-f9ea-42af-b9da-cfd2024d5871 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:50.014679 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-8d46b914-f9ea-42af-b9da-cfd2024d5871 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:50.016548 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-8d46b914-f9ea-42af-b9da-cfd2024d5871 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:50.018029 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-8d46b914-f9ea-42af-b9da-cfd2024d5871 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1281 microversion: 2.20 time: 0.102792 Aug 29 21:50:50.019395 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 20/43] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:50:49 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1281 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:50:50.926961 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Flavor limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:50:50.927538 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Image limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:50:50.927855 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Flavor pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:50:50.928264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Image pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:50:50.928704 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:50:50.944062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d0483143-d9ba-42fe-b308-9c0caf85b0af tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:50.945178 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:50.945310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d0483143-d9ba-42fe-b308-9c0caf85b0af tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:50.945665 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:50.946157 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:50.950069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:50.950069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:50.950069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:50.957168 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0483143-d9ba-42fe-b308-9c0caf85b0af tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:50.965832 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0483143-d9ba-42fe-b308-9c0caf85b0af tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:50.967186 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0483143-d9ba-42fe-b308-9c0caf85b0af tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:50.970467 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Getting quotas for project d45ce54651ad4326bccecbeea8b5b084. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:50:50.971757 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0483143-d9ba-42fe-b308-9c0caf85b0af tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:50.972448 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0483143-d9ba-42fe-b308-9c0caf85b0af tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:50.973379 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0483143-d9ba-42fe-b308-9c0caf85b0af tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:50.990182 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Getting quotas for user ed8ef9f9eafd4248bae86f0e8ec72731 and project d45ce54651ad4326bccecbeea8b5b084. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:50:51.031513 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Going to run 1 instances... {{(pid=127882) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:50:51.036542 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127882) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:50:51.134395 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d0483143-d9ba-42fe-b308-9c0caf85b0af tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:51.145888 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d0483143-d9ba-42fe-b308-9c0caf85b0af tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1267 microversion: 2.1 time: 0.210043 Aug 29 21:50:51.146918 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 21/44] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:50 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:50:51.152140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4e86ef19-2c2c-467e-88cc-3855660e0859 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:51.153625 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4e86ef19-2c2c-467e-88cc-3855660e0859 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:51.161065 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e86ef19-2c2c-467e-88cc-3855660e0859 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:51.181924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e86ef19-2c2c-467e-88cc-3855660e0859 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:51.181924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e86ef19-2c2c-467e-88cc-3855660e0859 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:51.181924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e86ef19-2c2c-467e-88cc-3855660e0859 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:51.181924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e86ef19-2c2c-467e-88cc-3855660e0859 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:51.182479 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e86ef19-2c2c-467e-88cc-3855660e0859 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:51.246398 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4e86ef19-2c2c-467e-88cc-3855660e0859 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:51.261300 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4e86ef19-2c2c-467e-88cc-3855660e0859 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:51.265184 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4e86ef19-2c2c-467e-88cc-3855660e0859 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:51.266741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4e86ef19-2c2c-467e-88cc-3855660e0859 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1285 microversion: 2.20 time: 0.118636 Aug 29 21:50:51.268635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 22/45] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:50:51 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:50:51.376147 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-999a4ff3-a44d-4188-a3d0-bd6d5233710f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.800272 Aug 29 21:50:51.377082 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 24/46] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:50:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:50:51.402461 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7d2686d0-6da5-46a3-b561-987c6f34bc6e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:51.404592 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7d2686d0-6da5-46a3-b561-987c6f34bc6e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:51.556560 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7d2686d0-6da5-46a3-b561-987c6f34bc6e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:51.581820 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7d2686d0-6da5-46a3-b561-987c6f34bc6e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1235 microversion: 2.1 time: 0.184271 Aug 29 21:50:51.598993 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 23/47] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:51 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1235 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:50:52.195422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a7274abd-fd05-4e15-b001-24790720b5a9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:52.196996 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a7274abd-fd05-4e15-b001-24790720b5a9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:52.212506 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a7274abd-fd05-4e15-b001-24790720b5a9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:52.213296 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a7274abd-fd05-4e15-b001-24790720b5a9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:52.215299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a7274abd-fd05-4e15-b001-24790720b5a9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:52.216526 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a7274abd-fd05-4e15-b001-24790720b5a9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:52.217155 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a7274abd-fd05-4e15-b001-24790720b5a9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:52.218117 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a7274abd-fd05-4e15-b001-24790720b5a9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:52.332681 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-adf83ed5-3e7e-4f97-b445-59619217fec9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:52.333505 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-adf83ed5-3e7e-4f97-b445-59619217fec9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:52.375147 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-adf83ed5-3e7e-4f97-b445-59619217fec9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:52.377858 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-adf83ed5-3e7e-4f97-b445-59619217fec9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:52.387646 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-adf83ed5-3e7e-4f97-b445-59619217fec9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:52.393806 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-adf83ed5-3e7e-4f97-b445-59619217fec9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:52.397558 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-adf83ed5-3e7e-4f97-b445-59619217fec9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:52.403938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-adf83ed5-3e7e-4f97-b445-59619217fec9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:52.630461 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a7274abd-fd05-4e15-b001-24790720b5a9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:52.649407 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a7274abd-fd05-4e15-b001-24790720b5a9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1285 microversion: 2.1 time: 0.463437 Aug 29 21:50:52.651919 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 25/48] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:52 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1285 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:50:52.652027 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-adf83ed5-3e7e-4f97-b445-59619217fec9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:52.668384 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c378fc05-8c63-483e-b99a-ce4b1c984f63 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:52.669251 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c378fc05-8c63-483e-b99a-ce4b1c984f63 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:52.680545 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-adf83ed5-3e7e-4f97-b445-59619217fec9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:52.689690 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-adf83ed5-3e7e-4f97-b445-59619217fec9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:52.690914 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-adf83ed5-3e7e-4f97-b445-59619217fec9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1277 microversion: 2.20 time: 0.374855 Aug 29 21:50:52.696459 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 24/49] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:50:52 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1277 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:50:52.869417 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c378fc05-8c63-483e-b99a-ce4b1c984f63 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:52.883288 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c378fc05-8c63-483e-b99a-ce4b1c984f63 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1235 microversion: 2.1 time: 0.218705 Aug 29 21:50:52.896707 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 26/50] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:52 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1235 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:50:53.671777 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-650028a7-2710-48d2-b246-b95441e337c6 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:53.672404 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-650028a7-2710-48d2-b246-b95441e337c6 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:53.679369 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-650028a7-2710-48d2-b246-b95441e337c6 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:53.679938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-650028a7-2710-48d2-b246-b95441e337c6 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:53.680389 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-650028a7-2710-48d2-b246-b95441e337c6 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:53.684220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-650028a7-2710-48d2-b246-b95441e337c6 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:53.684220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-650028a7-2710-48d2-b246-b95441e337c6 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:53.684220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-650028a7-2710-48d2-b246-b95441e337c6 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:53.728472 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-10af2636-b6d8-445e-a809-175e313f8c61 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:53.734785 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-10af2636-b6d8-445e-a809-175e313f8c61 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:53.748318 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10af2636-b6d8-445e-a809-175e313f8c61 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:53.750246 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10af2636-b6d8-445e-a809-175e313f8c61 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:53.751214 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10af2636-b6d8-445e-a809-175e313f8c61 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:53.755626 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10af2636-b6d8-445e-a809-175e313f8c61 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:53.759189 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10af2636-b6d8-445e-a809-175e313f8c61 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:53.760563 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10af2636-b6d8-445e-a809-175e313f8c61 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:53.898582 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-650028a7-2710-48d2-b246-b95441e337c6 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:53.906927 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-650028a7-2710-48d2-b246-b95441e337c6 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1273 microversion: 2.1 time: 0.239300 Aug 29 21:50:53.907524 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 25/51] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:53 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1273 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:50:53.928969 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-10af2636-b6d8-445e-a809-175e313f8c61 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:53.941170 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-10af2636-b6d8-445e-a809-175e313f8c61 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:53.943545 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-10af2636-b6d8-445e-a809-175e313f8c61 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:53.943664 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2013b65e-7761-4be4-97f8-15c5791e19cf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:53.943937 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2013b65e-7761-4be4-97f8-15c5791e19cf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:53.945057 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-10af2636-b6d8-445e-a809-175e313f8c61 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1333 microversion: 2.20 time: 0.226976 Aug 29 21:50:53.947583 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 27/52] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:50:53 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1333 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:50:53.964230 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2013b65e-7761-4be4-97f8-15c5791e19cf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:53.967209 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2013b65e-7761-4be4-97f8-15c5791e19cf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:53.967900 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2013b65e-7761-4be4-97f8-15c5791e19cf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:53.969481 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2013b65e-7761-4be4-97f8-15c5791e19cf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:53.970191 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2013b65e-7761-4be4-97f8-15c5791e19cf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:53.971879 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2013b65e-7761-4be4-97f8-15c5791e19cf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:54.077540 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2013b65e-7761-4be4-97f8-15c5791e19cf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:54.090093 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2013b65e-7761-4be4-97f8-15c5791e19cf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1239 microversion: 2.1 time: 0.150957 Aug 29 21:50:54.104846 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 26/53] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:53 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1239 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:50:54.930991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-1dda3110-c16b-4232-9931-117dba172d0b tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:54.931667 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-1dda3110-c16b-4232-9931-117dba172d0b tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:54.942218 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1dda3110-c16b-4232-9931-117dba172d0b tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:54.942964 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1dda3110-c16b-4232-9931-117dba172d0b tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:54.943571 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1dda3110-c16b-4232-9931-117dba172d0b tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:54.944362 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1dda3110-c16b-4232-9931-117dba172d0b tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:54.945027 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1dda3110-c16b-4232-9931-117dba172d0b tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:54.945510 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1dda3110-c16b-4232-9931-117dba172d0b tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:54.973439 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-9b8b5455-f0e9-4921-9ae4-39707cb2128d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:54.974700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-9b8b5455-f0e9-4921-9ae4-39707cb2128d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:54.982971 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9b8b5455-f0e9-4921-9ae4-39707cb2128d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:54.983463 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9b8b5455-f0e9-4921-9ae4-39707cb2128d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:54.988072 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9b8b5455-f0e9-4921-9ae4-39707cb2128d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:54.991518 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9b8b5455-f0e9-4921-9ae4-39707cb2128d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:54.992190 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9b8b5455-f0e9-4921-9ae4-39707cb2128d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:55.002718 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9b8b5455-f0e9-4921-9ae4-39707cb2128d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:55.169685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:55.221231 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9b8b5455-f0e9-4921-9ae4-39707cb2128d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:55.239009 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9b8b5455-f0e9-4921-9ae4-39707cb2128d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:55.250117 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9b8b5455-f0e9-4921-9ae4-39707cb2128d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:55.253171 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-9b8b5455-f0e9-4921-9ae4-39707cb2128d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1339 microversion: 2.20 time: 0.283962 Aug 29 21:50:55.255004 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 27/54] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:50:54 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1339 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:50:55.277523 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6e3d6f3c-3f64-4e21-9eea-679cf3c03c15 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:55.277523 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6e3d6f3c-3f64-4e21-9eea-679cf3c03c15 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:55.284428 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e3d6f3c-3f64-4e21-9eea-679cf3c03c15 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:55.289686 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e3d6f3c-3f64-4e21-9eea-679cf3c03c15 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:55.290535 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e3d6f3c-3f64-4e21-9eea-679cf3c03c15 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:55.292603 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e3d6f3c-3f64-4e21-9eea-679cf3c03c15 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:55.293476 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e3d6f3c-3f64-4e21-9eea-679cf3c03c15 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:55.294352 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e3d6f3c-3f64-4e21-9eea-679cf3c03c15 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:55.479948 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1dda3110-c16b-4232-9931-117dba172d0b tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:55.488275 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6e3d6f3c-3f64-4e21-9eea-679cf3c03c15 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:55.512780 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-1dda3110-c16b-4232-9931-117dba172d0b tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.565634 Aug 29 21:50:55.512780 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 28/55] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:54 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:50:55.523347 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6e3d6f3c-3f64-4e21-9eea-679cf3c03c15 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1287 microversion: 2.1 time: 0.266417 Aug 29 21:50:55.557370 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 28/56] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:55 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1287 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:50:56.285631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b535ef96-9c53-48ba-ad83-fe779d99f757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:56.287719 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b535ef96-9c53-48ba-ad83-fe779d99f757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:56.294852 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b535ef96-9c53-48ba-ad83-fe779d99f757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:56.296419 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b535ef96-9c53-48ba-ad83-fe779d99f757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:56.297094 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b535ef96-9c53-48ba-ad83-fe779d99f757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:56.298022 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b535ef96-9c53-48ba-ad83-fe779d99f757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:56.298660 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b535ef96-9c53-48ba-ad83-fe779d99f757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:56.299264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b535ef96-9c53-48ba-ad83-fe779d99f757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:56.647616 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e60304a6-aeb7-421f-87eb-60020a9fb05f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:56.647616 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e60304a6-aeb7-421f-87eb-60020a9fb05f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:56.647616 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e60304a6-aeb7-421f-87eb-60020a9fb05f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:56.647616 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e60304a6-aeb7-421f-87eb-60020a9fb05f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:56.651192 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e60304a6-aeb7-421f-87eb-60020a9fb05f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:56.651192 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e60304a6-aeb7-421f-87eb-60020a9fb05f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:56.651192 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e60304a6-aeb7-421f-87eb-60020a9fb05f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:56.651192 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e60304a6-aeb7-421f-87eb-60020a9fb05f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:57.267691 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e60304a6-aeb7-421f-87eb-60020a9fb05f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:57.277693 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b535ef96-9c53-48ba-ad83-fe779d99f757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:57.312229 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e60304a6-aeb7-421f-87eb-60020a9fb05f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.782200 Aug 29 21:50:57.333228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 29/57] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:56 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:50:57.342753 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b535ef96-9c53-48ba-ad83-fe779d99f757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:57.344740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b535ef96-9c53-48ba-ad83-fe779d99f757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:57.352020 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d0a37590-f1df-43b4-a1db-c01783c7a6ad tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:57.352728 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d0a37590-f1df-43b4-a1db-c01783c7a6ad tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:57.357805 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b535ef96-9c53-48ba-ad83-fe779d99f757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 1.076056 Aug 29 21:50:57.359944 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 29/58] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:50:56 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:50:57.375290 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0a37590-f1df-43b4-a1db-c01783c7a6ad tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:57.378945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0a37590-f1df-43b4-a1db-c01783c7a6ad tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:57.378945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0a37590-f1df-43b4-a1db-c01783c7a6ad tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:57.380601 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0a37590-f1df-43b4-a1db-c01783c7a6ad tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:57.381107 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0a37590-f1df-43b4-a1db-c01783c7a6ad tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:57.381555 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0a37590-f1df-43b4-a1db-c01783c7a6ad tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:57.611560 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d0a37590-f1df-43b4-a1db-c01783c7a6ad tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:57.646892 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d0a37590-f1df-43b4-a1db-c01783c7a6ad tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1305 microversion: 2.1 time: 0.311974 Aug 29 21:50:57.655620 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 30/59] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:57 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1305 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:50:58.357465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-bfdf2320-aa4a-41c5-a853-4b087e619c92 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:58.359629 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-bfdf2320-aa4a-41c5-a853-4b087e619c92 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:58.380628 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bfdf2320-aa4a-41c5-a853-4b087e619c92 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:58.380628 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bfdf2320-aa4a-41c5-a853-4b087e619c92 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:58.380628 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bfdf2320-aa4a-41c5-a853-4b087e619c92 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:58.380628 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bfdf2320-aa4a-41c5-a853-4b087e619c92 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:58.382082 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bfdf2320-aa4a-41c5-a853-4b087e619c92 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:58.383751 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bfdf2320-aa4a-41c5-a853-4b087e619c92 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:58.406607 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0f3e610e-3660-489b-bceb-e990890962a1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:58.412045 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0f3e610e-3660-489b-bceb-e990890962a1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:58.441530 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0f3e610e-3660-489b-bceb-e990890962a1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:58.441530 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0f3e610e-3660-489b-bceb-e990890962a1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:58.441530 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0f3e610e-3660-489b-bceb-e990890962a1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:58.441530 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0f3e610e-3660-489b-bceb-e990890962a1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:58.443200 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0f3e610e-3660-489b-bceb-e990890962a1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:58.446356 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0f3e610e-3660-489b-bceb-e990890962a1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:59.261294 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0f3e610e-3660-489b-bceb-e990890962a1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:59.316619 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0f3e610e-3660-489b-bceb-e990890962a1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:59.323369 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0f3e610e-3660-489b-bceb-e990890962a1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:59.329216 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0f3e610e-3660-489b-bceb-e990890962a1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.939512 Aug 29 21:50:59.329216 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 31/60] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:50:58 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:50:59.358576 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6107509b-3703-48a1-8580-77bf9f362df4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:50:59.358576 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6107509b-3703-48a1-8580-77bf9f362df4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:50:59.404283 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6107509b-3703-48a1-8580-77bf9f362df4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:59.404283 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6107509b-3703-48a1-8580-77bf9f362df4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:59.404283 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6107509b-3703-48a1-8580-77bf9f362df4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:59.412407 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6107509b-3703-48a1-8580-77bf9f362df4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:50:59.415163 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6107509b-3703-48a1-8580-77bf9f362df4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:50:59.422003 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6107509b-3703-48a1-8580-77bf9f362df4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:50:59.763768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-bfdf2320-aa4a-41c5-a853-4b087e619c92 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:59.777326 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-bfdf2320-aa4a-41c5-a853-4b087e619c92 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 1.426004 Aug 29 21:50:59.788514 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 30/61] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:58 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:50:59.788754 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6107509b-3703-48a1-8580-77bf9f362df4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:50:59.793969 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6107509b-3703-48a1-8580-77bf9f362df4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1293 microversion: 2.1 time: 0.467112 Aug 29 21:50:59.800217 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 32/62] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:50:59 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1293 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:00.358765 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2badfc71-b132-4ed2-919e-8cccacbbb521 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:00.366148 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2badfc71-b132-4ed2-919e-8cccacbbb521 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:00.403807 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2badfc71-b132-4ed2-919e-8cccacbbb521 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:00.405719 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2badfc71-b132-4ed2-919e-8cccacbbb521 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:00.406924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2badfc71-b132-4ed2-919e-8cccacbbb521 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:00.408646 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2badfc71-b132-4ed2-919e-8cccacbbb521 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:00.409858 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2badfc71-b132-4ed2-919e-8cccacbbb521 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:00.410887 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2badfc71-b132-4ed2-919e-8cccacbbb521 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:00.832447 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-68e6f347-5d4d-4d9f-a797-f1b338d7453a req-9e41033e-68aa-425f-b1b8-a825d7c80f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6226c525-5ef4-4f3e-b09d-b4c38b6bd367", "tag": "671a0014-dd0d-4ecc-9b85-607c479d6da5"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:51:00.876405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-68e6f347-5d4d-4d9f-a797-f1b338d7453a req-9e41033e-68aa-425f-b1b8-a825d7c80f52 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:00.877791 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-68e6f347-5d4d-4d9f-a797-f1b338d7453a req-9e41033e-68aa-425f-b1b8-a825d7c80f52 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:00.879615 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-68e6f347-5d4d-4d9f-a797-f1b338d7453a req-9e41033e-68aa-425f-b1b8-a825d7c80f52 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:00.958684 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=4 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:00.968804 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-68e6f347-5d4d-4d9f-a797-f1b338d7453a req-9e41033e-68aa-425f-b1b8-a825d7c80f52 service nova] Creating event network-changed:671a0014-dd0d-4ecc-9b85-607c479d6da5 for instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 on hv-cinder-85426 Aug 29 21:51:00.969718 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-68e6f347-5d4d-4d9f-a797-f1b338d7453a req-9e41033e-68aa-425f-b1b8-a825d7c80f52 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127882) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 21:51:00.970400 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-68e6f347-5d4d-4d9f-a797-f1b338d7453a req-9e41033e-68aa-425f-b1b8-a825d7c80f52 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127882) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 21:51:00.972231 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6af5b63a-4b83-4122-8adb-ffeea0ba8c84 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:00.973071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6af5b63a-4b83-4122-8adb-ffeea0ba8c84 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:00.993949 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6af5b63a-4b83-4122-8adb-ffeea0ba8c84 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:00.996681 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6af5b63a-4b83-4122-8adb-ffeea0ba8c84 None None] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:00.997810 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6af5b63a-4b83-4122-8adb-ffeea0ba8c84 None None] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:00.998905 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6af5b63a-4b83-4122-8adb-ffeea0ba8c84 None None] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:01.062890 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.compute.rpcapi [None req-6af5b63a-4b83-4122-8adb-ffeea0ba8c84 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 21:51:01.064746 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6af5b63a-4b83-4122-8adb-ffeea0ba8c84 None None] Releasing lock "compute-rpcapi-router" {{(pid=127882) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 21:51:01.099650 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2badfc71-b132-4ed2-919e-8cccacbbb521 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:01.137167 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-6af5b63a-4b83-4122-8adb-ffeea0ba8c84 None None] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.356895 Aug 29 21:51:01.145804 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 31/63] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:51:01.148963 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2badfc71-b132-4ed2-919e-8cccacbbb521 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:01.152721 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2badfc71-b132-4ed2-919e-8cccacbbb521 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:01.162279 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2badfc71-b132-4ed2-919e-8cccacbbb521 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.814003 Aug 29 21:51:01.163283 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 33/64] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:00 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:51:01.198553 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-3f6ca27b-9d3a-4ef7-bf80-d79edac11900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:01.200190 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3f6ca27b-9d3a-4ef7-bf80-d79edac11900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:01.220119 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-429012d2-cd14-42ac-b336-4610b90284d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:01.224040 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-429012d2-cd14-42ac-b336-4610b90284d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:01.244206 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3f6ca27b-9d3a-4ef7-bf80-d79edac11900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:01.245221 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3f6ca27b-9d3a-4ef7-bf80-d79edac11900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:01.256166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3f6ca27b-9d3a-4ef7-bf80-d79edac11900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:01.266255 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3f6ca27b-9d3a-4ef7-bf80-d79edac11900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:01.271518 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-429012d2-cd14-42ac-b336-4610b90284d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:01.272876 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3f6ca27b-9d3a-4ef7-bf80-d79edac11900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:01.273720 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3f6ca27b-9d3a-4ef7-bf80-d79edac11900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:01.287400 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-429012d2-cd14-42ac-b336-4610b90284d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:01.287400 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-429012d2-cd14-42ac-b336-4610b90284d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:01.287794 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-429012d2-cd14-42ac-b336-4610b90284d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:01.288329 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-429012d2-cd14-42ac-b336-4610b90284d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:01.289505 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-429012d2-cd14-42ac-b336-4610b90284d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:01.564143 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=20 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:01.873666 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-3f6ca27b-9d3a-4ef7-bf80-d79edac11900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:01.893066 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-3f6ca27b-9d3a-4ef7-bf80-d79edac11900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.738648 Aug 29 21:51:01.897639 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 32/65] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:01 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:02.202172 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4d975024-fae8-4ed0-a901-921017d20822 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:02.202947 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4d975024-fae8-4ed0-a901-921017d20822 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:02.216661 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4d975024-fae8-4ed0-a901-921017d20822 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:02.217589 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4d975024-fae8-4ed0-a901-921017d20822 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:02.226074 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4d975024-fae8-4ed0-a901-921017d20822 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:02.227195 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4d975024-fae8-4ed0-a901-921017d20822 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:02.227867 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4d975024-fae8-4ed0-a901-921017d20822 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:02.228474 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4d975024-fae8-4ed0-a901-921017d20822 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:02.706459 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-429012d2-cd14-42ac-b336-4610b90284d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:02.749006 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-429012d2-cd14-42ac-b336-4610b90284d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 1.557843 Aug 29 21:51:02.758251 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 34/66] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:01 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:02.800196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4d975024-fae8-4ed0-a901-921017d20822 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:02.800196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4d975024-fae8-4ed0-a901-921017d20822 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:02.801796 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4d975024-fae8-4ed0-a901-921017d20822 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:02.801796 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4d975024-fae8-4ed0-a901-921017d20822 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.601823 Aug 29 21:51:02.803475 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 33/67] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:02 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:51:02.936407 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-c3b5cb40-809e-4720-80c9-cbbe66331473 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:02.939664 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-c3b5cb40-809e-4720-80c9-cbbe66331473 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:02.982587 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c3b5cb40-809e-4720-80c9-cbbe66331473 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:02.990585 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c3b5cb40-809e-4720-80c9-cbbe66331473 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:02.994441 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c3b5cb40-809e-4720-80c9-cbbe66331473 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:02.995301 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c3b5cb40-809e-4720-80c9-cbbe66331473 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:03.000157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c3b5cb40-809e-4720-80c9-cbbe66331473 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:03.001037 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c3b5cb40-809e-4720-80c9-cbbe66331473 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:03.193584 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-4970b5b0-f3ec-4b8a-aa9a-ca40def8936b req-c5ddb3d7-3543-4b8a-bc7a-aa6da086dea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e60ebcd-98c1-4442-9c72-f4d9760c8d6f", "tag": "b49d987f-0fff-47f7-acee-6d31bbdeab4b"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:51:03.219561 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=20 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:03.223825 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-4970b5b0-f3ec-4b8a-aa9a-ca40def8936b req-c5ddb3d7-3543-4b8a-bc7a-aa6da086dea3 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:03.224840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-4970b5b0-f3ec-4b8a-aa9a-ca40def8936b req-c5ddb3d7-3543-4b8a-bc7a-aa6da086dea3 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:03.225584 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-4970b5b0-f3ec-4b8a-aa9a-ca40def8936b req-c5ddb3d7-3543-4b8a-bc7a-aa6da086dea3 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:03.242954 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-4970b5b0-f3ec-4b8a-aa9a-ca40def8936b req-c5ddb3d7-3543-4b8a-bc7a-aa6da086dea3 service nova] Creating event network-changed:b49d987f-0fff-47f7-acee-6d31bbdeab4b for instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f on hv-cinder-85426 Aug 29 21:51:03.249635 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-4970b5b0-f3ec-4b8a-aa9a-ca40def8936b req-c5ddb3d7-3543-4b8a-bc7a-aa6da086dea3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076915 Aug 29 21:51:03.250888 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 34/68] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:51:03.589277 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-c3b5cb40-809e-4720-80c9-cbbe66331473 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:03.604399 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-c3b5cb40-809e-4720-80c9-cbbe66331473 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.681968 Aug 29 21:51:03.605326 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 35/69] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:02 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:03.863385 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-1d244cb8-c3e0-432b-a11b-263cb884d125 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:03.863634 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6cf53b8c-7d32-488e-a0f3-bb1e10cec230 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:03.863634 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6cf53b8c-7d32-488e-a0f3-bb1e10cec230 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:03.864198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-1d244cb8-c3e0-432b-a11b-263cb884d125 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:03.864198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1d244cb8-c3e0-432b-a11b-263cb884d125 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:03.864198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1d244cb8-c3e0-432b-a11b-263cb884d125 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:03.864198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1d244cb8-c3e0-432b-a11b-263cb884d125 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:03.864457 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1d244cb8-c3e0-432b-a11b-263cb884d125 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:03.865047 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1d244cb8-c3e0-432b-a11b-263cb884d125 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:03.865640 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1d244cb8-c3e0-432b-a11b-263cb884d125 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:03.870671 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6cf53b8c-7d32-488e-a0f3-bb1e10cec230 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:03.871395 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6cf53b8c-7d32-488e-a0f3-bb1e10cec230 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:03.871963 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6cf53b8c-7d32-488e-a0f3-bb1e10cec230 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:03.872885 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6cf53b8c-7d32-488e-a0f3-bb1e10cec230 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:03.873636 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6cf53b8c-7d32-488e-a0f3-bb1e10cec230 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:03.874267 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6cf53b8c-7d32-488e-a0f3-bb1e10cec230 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:04.307106 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1d244cb8-c3e0-432b-a11b-263cb884d125 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:04.329295 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-1d244cb8-c3e0-432b-a11b-263cb884d125 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.494362 Aug 29 21:51:04.330556 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 35/70] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:03 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:04.535461 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6cf53b8c-7d32-488e-a0f3-bb1e10cec230 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:04.553841 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6cf53b8c-7d32-488e-a0f3-bb1e10cec230 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:04.560671 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6cf53b8c-7d32-488e-a0f3-bb1e10cec230 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:04.563361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6cf53b8c-7d32-488e-a0f3-bb1e10cec230 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.728329 Aug 29 21:51:04.577715 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 36/71] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:03 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:51:04.637541 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-90b44dab-af99-4716-b517-e479f3aab2c3 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:04.637541 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-90b44dab-af99-4716-b517-e479f3aab2c3 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:04.652102 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-90b44dab-af99-4716-b517-e479f3aab2c3 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:04.656115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-90b44dab-af99-4716-b517-e479f3aab2c3 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:04.657628 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-90b44dab-af99-4716-b517-e479f3aab2c3 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:04.658449 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-90b44dab-af99-4716-b517-e479f3aab2c3 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:04.658962 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-90b44dab-af99-4716-b517-e479f3aab2c3 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:04.662189 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-90b44dab-af99-4716-b517-e479f3aab2c3 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:05.181866 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-90b44dab-af99-4716-b517-e479f3aab2c3 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:05.194354 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-90b44dab-af99-4716-b517-e479f3aab2c3 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.563929 Aug 29 21:51:05.208511 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 36/72] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:04 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:05.368780 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e5d7609a-74c8-4af6-aa30-68b6732eaae7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:05.369452 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e5d7609a-74c8-4af6-aa30-68b6732eaae7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:05.380827 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5d7609a-74c8-4af6-aa30-68b6732eaae7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:05.386130 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5d7609a-74c8-4af6-aa30-68b6732eaae7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:05.386130 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5d7609a-74c8-4af6-aa30-68b6732eaae7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:05.386130 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5d7609a-74c8-4af6-aa30-68b6732eaae7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:05.386130 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5d7609a-74c8-4af6-aa30-68b6732eaae7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:05.386648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5d7609a-74c8-4af6-aa30-68b6732eaae7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:05.410424 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=100 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:05.776977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-2a525ef0-1b02-41de-89ca-a619ead0252e req-65a580cd-d8a3-4966-850d-7d0d00bb29bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93cc4db2-465f-41c0-8689-d78cccae7601", "tag": "863a5e0b-36a2-41bd-97bc-0a4f754bad9b"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:51:05.782714 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:05.806173 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-2a525ef0-1b02-41de-89ca-a619ead0252e req-65a580cd-d8a3-4966-850d-7d0d00bb29bb service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:05.807193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-2a525ef0-1b02-41de-89ca-a619ead0252e req-65a580cd-d8a3-4966-850d-7d0d00bb29bb service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:05.808273 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-2a525ef0-1b02-41de-89ca-a619ead0252e req-65a580cd-d8a3-4966-850d-7d0d00bb29bb service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:05.853780 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-2a525ef0-1b02-41de-89ca-a619ead0252e req-65a580cd-d8a3-4966-850d-7d0d00bb29bb service nova] Creating event network-changed:863a5e0b-36a2-41bd-97bc-0a4f754bad9b for instance 93cc4db2-465f-41c0-8689-d78cccae7601 on hv-cinder-85426 Aug 29 21:51:05.861518 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-2a525ef0-1b02-41de-89ca-a619ead0252e req-65a580cd-d8a3-4966-850d-7d0d00bb29bb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.340276 Aug 29 21:51:05.862862 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 37/73] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:51:05.870025 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9dacf46e-1957-492a-909b-87159b4ebfba tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:05.870998 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9dacf46e-1957-492a-909b-87159b4ebfba tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:05.878533 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9dacf46e-1957-492a-909b-87159b4ebfba tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:05.879279 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9dacf46e-1957-492a-909b-87159b4ebfba tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:05.879893 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9dacf46e-1957-492a-909b-87159b4ebfba tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:05.881056 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9dacf46e-1957-492a-909b-87159b4ebfba tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:05.881640 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9dacf46e-1957-492a-909b-87159b4ebfba tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:05.882197 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9dacf46e-1957-492a-909b-87159b4ebfba tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:06.221258 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9dacf46e-1957-492a-909b-87159b4ebfba tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:06.236724 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9dacf46e-1957-492a-909b-87159b4ebfba tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:06.240383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9dacf46e-1957-492a-909b-87159b4ebfba tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:06.244041 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9dacf46e-1957-492a-909b-87159b4ebfba tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.378752 Aug 29 21:51:06.244611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 38/74] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:05 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:51:06.259760 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e5d7609a-74c8-4af6-aa30-68b6732eaae7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:06.272024 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e5d7609a-74c8-4af6-aa30-68b6732eaae7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.909346 Aug 29 21:51:06.273148 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 37/75] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:05 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:06.275591 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5adb7bf7-ea18-49f6-b199-316853a9c81e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:06.283067 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5adb7bf7-ea18-49f6-b199-316853a9c81e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:06.294325 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5adb7bf7-ea18-49f6-b199-316853a9c81e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:06.299456 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5adb7bf7-ea18-49f6-b199-316853a9c81e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:06.300427 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5adb7bf7-ea18-49f6-b199-316853a9c81e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:06.301758 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5adb7bf7-ea18-49f6-b199-316853a9c81e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:06.302464 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5adb7bf7-ea18-49f6-b199-316853a9c81e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:06.303346 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5adb7bf7-ea18-49f6-b199-316853a9c81e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:06.599783 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5adb7bf7-ea18-49f6-b199-316853a9c81e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:06.612804 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5adb7bf7-ea18-49f6-b199-316853a9c81e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.348973 Aug 29 21:51:06.613539 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 39/76] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:06 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:07.278339 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-104f07ac-c34e-455d-b6db-058c6bd8fc99 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:07.285201 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-104f07ac-c34e-455d-b6db-058c6bd8fc99 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:07.303479 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-564adb50-f78d-4a81-99b3-503d0af20ee0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:07.311801 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-564adb50-f78d-4a81-99b3-503d0af20ee0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:07.324238 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:07.331706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-104f07ac-c34e-455d-b6db-058c6bd8fc99 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:07.338156 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-104f07ac-c34e-455d-b6db-058c6bd8fc99 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:07.340071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-104f07ac-c34e-455d-b6db-058c6bd8fc99 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:07.344798 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-564adb50-f78d-4a81-99b3-503d0af20ee0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:07.346127 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-104f07ac-c34e-455d-b6db-058c6bd8fc99 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:07.347321 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-104f07ac-c34e-455d-b6db-058c6bd8fc99 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:07.349054 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-104f07ac-c34e-455d-b6db-058c6bd8fc99 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:07.350109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-564adb50-f78d-4a81-99b3-503d0af20ee0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:07.351189 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-564adb50-f78d-4a81-99b3-503d0af20ee0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:07.354290 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-564adb50-f78d-4a81-99b3-503d0af20ee0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:07.371011 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-564adb50-f78d-4a81-99b3-503d0af20ee0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:07.371011 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-564adb50-f78d-4a81-99b3-503d0af20ee0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:07.777255 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-564adb50-f78d-4a81-99b3-503d0af20ee0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:07.830905 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-564adb50-f78d-4a81-99b3-503d0af20ee0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.535020 Aug 29 21:51:07.831448 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 40/77] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:07 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:07.853649 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-104f07ac-c34e-455d-b6db-058c6bd8fc99 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:07.857751 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-001b7c41-a75e-4204-8679-1acedd7799fd tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:07.862677 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-001b7c41-a75e-4204-8679-1acedd7799fd tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:07.869545 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-104f07ac-c34e-455d-b6db-058c6bd8fc99 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:07.871115 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-104f07ac-c34e-455d-b6db-058c6bd8fc99 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:07.872297 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-104f07ac-c34e-455d-b6db-058c6bd8fc99 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.602699 Aug 29 21:51:07.872917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 38/78] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:07 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:51:07.876857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-001b7c41-a75e-4204-8679-1acedd7799fd tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:07.884704 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-001b7c41-a75e-4204-8679-1acedd7799fd tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:07.885617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-001b7c41-a75e-4204-8679-1acedd7799fd tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:07.886544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-001b7c41-a75e-4204-8679-1acedd7799fd tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:07.887188 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-001b7c41-a75e-4204-8679-1acedd7799fd tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:07.890232 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-001b7c41-a75e-4204-8679-1acedd7799fd tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:08.274198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-001b7c41-a75e-4204-8679-1acedd7799fd tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:08.282994 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-001b7c41-a75e-4204-8679-1acedd7799fd tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.434913 Aug 29 21:51:08.284502 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 41/79] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:07 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:08.855014 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-61a4a4fa-fdb7-4581-8322-00d2a2be4382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:08.855987 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-61a4a4fa-fdb7-4581-8322-00d2a2be4382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:08.867649 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-61a4a4fa-fdb7-4581-8322-00d2a2be4382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:08.868448 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-61a4a4fa-fdb7-4581-8322-00d2a2be4382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:08.869118 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-61a4a4fa-fdb7-4581-8322-00d2a2be4382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:08.870084 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-61a4a4fa-fdb7-4581-8322-00d2a2be4382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:08.870721 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-61a4a4fa-fdb7-4581-8322-00d2a2be4382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:08.871249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-61a4a4fa-fdb7-4581-8322-00d2a2be4382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:08.900645 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2883d26f-1f83-4d66-b8de-009dbe91b1eb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:08.902100 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2883d26f-1f83-4d66-b8de-009dbe91b1eb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:08.908831 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2883d26f-1f83-4d66-b8de-009dbe91b1eb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:08.909319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2883d26f-1f83-4d66-b8de-009dbe91b1eb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:08.909790 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2883d26f-1f83-4d66-b8de-009dbe91b1eb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:08.910697 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2883d26f-1f83-4d66-b8de-009dbe91b1eb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:08.911351 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2883d26f-1f83-4d66-b8de-009dbe91b1eb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:08.911830 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2883d26f-1f83-4d66-b8de-009dbe91b1eb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:09.045812 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-61a4a4fa-fdb7-4581-8322-00d2a2be4382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:09.054740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-61a4a4fa-fdb7-4581-8322-00d2a2be4382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.204726 Aug 29 21:51:09.068568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 39/80] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:08 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:09.274717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2883d26f-1f83-4d66-b8de-009dbe91b1eb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:09.285854 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2883d26f-1f83-4d66-b8de-009dbe91b1eb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:09.287298 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2883d26f-1f83-4d66-b8de-009dbe91b1eb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:09.288405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2883d26f-1f83-4d66-b8de-009dbe91b1eb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.392703 Aug 29 21:51:09.288981 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 42/81] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:08 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:51:09.345518 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-33794ce0-a99e-413d-8415-88781d867a57 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:09.345518 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-33794ce0-a99e-413d-8415-88781d867a57 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:09.345518 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-33794ce0-a99e-413d-8415-88781d867a57 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:09.345518 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-33794ce0-a99e-413d-8415-88781d867a57 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:09.346052 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-33794ce0-a99e-413d-8415-88781d867a57 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:09.346052 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-33794ce0-a99e-413d-8415-88781d867a57 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:09.346052 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-33794ce0-a99e-413d-8415-88781d867a57 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:09.346052 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-33794ce0-a99e-413d-8415-88781d867a57 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:09.507787 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-33794ce0-a99e-413d-8415-88781d867a57 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:09.516288 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-33794ce0-a99e-413d-8415-88781d867a57 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.213339 Aug 29 21:51:09.517265 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 40/82] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:09 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:10.080782 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4acdb2a4-3ce7-494c-8a5b-ba8fa23c65de tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:10.081487 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4acdb2a4-3ce7-494c-8a5b-ba8fa23c65de tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:10.087961 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4acdb2a4-3ce7-494c-8a5b-ba8fa23c65de tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:10.088513 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4acdb2a4-3ce7-494c-8a5b-ba8fa23c65de tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:10.089042 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4acdb2a4-3ce7-494c-8a5b-ba8fa23c65de tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:10.089799 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4acdb2a4-3ce7-494c-8a5b-ba8fa23c65de tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:10.090258 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4acdb2a4-3ce7-494c-8a5b-ba8fa23c65de tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:10.090688 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4acdb2a4-3ce7-494c-8a5b-ba8fa23c65de tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:10.111326 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=100 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:10.268988 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4acdb2a4-3ce7-494c-8a5b-ba8fa23c65de tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:10.277987 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4acdb2a4-3ce7-494c-8a5b-ba8fa23c65de tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.202490 Aug 29 21:51:10.283261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 43/83] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:10 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:10.315755 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-43437f3b-3632-4b0a-a932-9390bc47daac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:10.315755 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-43437f3b-3632-4b0a-a932-9390bc47daac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:10.326197 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-43437f3b-3632-4b0a-a932-9390bc47daac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:10.327096 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-43437f3b-3632-4b0a-a932-9390bc47daac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:10.327878 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-43437f3b-3632-4b0a-a932-9390bc47daac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:10.329552 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-43437f3b-3632-4b0a-a932-9390bc47daac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:10.330345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-43437f3b-3632-4b0a-a932-9390bc47daac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:10.331103 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-43437f3b-3632-4b0a-a932-9390bc47daac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:10.499677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-43437f3b-3632-4b0a-a932-9390bc47daac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:10.511160 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-43437f3b-3632-4b0a-a932-9390bc47daac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:10.516397 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-43437f3b-3632-4b0a-a932-9390bc47daac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:10.519078 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-43437f3b-3632-4b0a-a932-9390bc47daac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.210982 Aug 29 21:51:10.519685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 41/84] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:10 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:51:10.545518 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2a862fba-8726-48b9-8c9b-06895ab290b9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:10.547307 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2a862fba-8726-48b9-8c9b-06895ab290b9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:10.554961 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a862fba-8726-48b9-8c9b-06895ab290b9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:10.555614 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a862fba-8726-48b9-8c9b-06895ab290b9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:10.556151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a862fba-8726-48b9-8c9b-06895ab290b9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:10.557233 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a862fba-8726-48b9-8c9b-06895ab290b9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:10.557693 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a862fba-8726-48b9-8c9b-06895ab290b9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:10.558283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a862fba-8726-48b9-8c9b-06895ab290b9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:10.731334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2a862fba-8726-48b9-8c9b-06895ab290b9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:10.739686 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2a862fba-8726-48b9-8c9b-06895ab290b9 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.199991 Aug 29 21:51:10.740274 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 44/85] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:10 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:11.317399 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-991fce05-850e-482d-81ff-cd76cb4adfc6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:11.318249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-991fce05-850e-482d-81ff-cd76cb4adfc6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:11.325056 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-991fce05-850e-482d-81ff-cd76cb4adfc6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:11.325558 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-991fce05-850e-482d-81ff-cd76cb4adfc6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:11.326040 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-991fce05-850e-482d-81ff-cd76cb4adfc6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:11.326797 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-991fce05-850e-482d-81ff-cd76cb4adfc6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:11.327262 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-991fce05-850e-482d-81ff-cd76cb4adfc6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:11.327695 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-991fce05-850e-482d-81ff-cd76cb4adfc6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:11.530472 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-991fce05-850e-482d-81ff-cd76cb4adfc6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:11.546814 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-991fce05-850e-482d-81ff-cd76cb4adfc6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.231824 Aug 29 21:51:11.547620 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 42/86] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:11 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:11.551440 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-15a56c86-017a-4dde-9788-b5e538ce06be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:11.553174 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-15a56c86-017a-4dde-9788-b5e538ce06be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:11.573180 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15a56c86-017a-4dde-9788-b5e538ce06be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:11.575668 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15a56c86-017a-4dde-9788-b5e538ce06be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:11.576919 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15a56c86-017a-4dde-9788-b5e538ce06be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:11.578533 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15a56c86-017a-4dde-9788-b5e538ce06be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:11.579701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15a56c86-017a-4dde-9788-b5e538ce06be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:11.580822 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15a56c86-017a-4dde-9788-b5e538ce06be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:11.767383 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-190b997c-531a-493f-a330-f51639b7e10e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:11.768752 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-190b997c-531a-493f-a330-f51639b7e10e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:11.788690 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-190b997c-531a-493f-a330-f51639b7e10e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:11.792875 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-190b997c-531a-493f-a330-f51639b7e10e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:11.798560 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-190b997c-531a-493f-a330-f51639b7e10e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:11.804233 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-190b997c-531a-493f-a330-f51639b7e10e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:11.806061 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-190b997c-531a-493f-a330-f51639b7e10e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:11.807748 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-190b997c-531a-493f-a330-f51639b7e10e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:11.833337 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-15a56c86-017a-4dde-9788-b5e538ce06be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:11.855054 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-15a56c86-017a-4dde-9788-b5e538ce06be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:11.857100 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-15a56c86-017a-4dde-9788-b5e538ce06be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:11.865038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-15a56c86-017a-4dde-9788-b5e538ce06be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.324404 Aug 29 21:51:11.871882 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 45/87] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:11 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:51:12.072140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-190b997c-531a-493f-a330-f51639b7e10e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:12.080107 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-190b997c-531a-493f-a330-f51639b7e10e tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.321883 Aug 29 21:51:12.080808 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 43/88] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:11 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:12.564066 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=2 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:12.568824 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-05be3be0-7fb3-43c8-8ebc-a6372df2bfab tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:12.583513 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-05be3be0-7fb3-43c8-8ebc-a6372df2bfab tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:12.591016 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-05be3be0-7fb3-43c8-8ebc-a6372df2bfab tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:12.592391 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-05be3be0-7fb3-43c8-8ebc-a6372df2bfab tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:12.593027 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-05be3be0-7fb3-43c8-8ebc-a6372df2bfab tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:12.594117 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-05be3be0-7fb3-43c8-8ebc-a6372df2bfab tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:12.594776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-05be3be0-7fb3-43c8-8ebc-a6372df2bfab tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:12.595303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-05be3be0-7fb3-43c8-8ebc-a6372df2bfab tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:12.763366 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-05be3be0-7fb3-43c8-8ebc-a6372df2bfab tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:12.772089 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-05be3be0-7fb3-43c8-8ebc-a6372df2bfab tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.208664 Aug 29 21:51:12.772717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 46/89] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:12 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:12.899201 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-65a9021b-274c-4184-b1cf-a1ff8ad6516b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:12.899201 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-65a9021b-274c-4184-b1cf-a1ff8ad6516b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:12.901512 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-65a9021b-274c-4184-b1cf-a1ff8ad6516b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:12.902006 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-65a9021b-274c-4184-b1cf-a1ff8ad6516b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:12.902442 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-65a9021b-274c-4184-b1cf-a1ff8ad6516b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:12.903180 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-65a9021b-274c-4184-b1cf-a1ff8ad6516b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:12.903630 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-65a9021b-274c-4184-b1cf-a1ff8ad6516b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:12.904331 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-65a9021b-274c-4184-b1cf-a1ff8ad6516b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:13.064400 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-65a9021b-274c-4184-b1cf-a1ff8ad6516b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:13.072609 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-65a9021b-274c-4184-b1cf-a1ff8ad6516b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:13.074157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-65a9021b-274c-4184-b1cf-a1ff8ad6516b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:13.075273 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-65a9021b-274c-4184-b1cf-a1ff8ad6516b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.184930 Aug 29 21:51:13.076015 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 44/90] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:12 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:51:13.101441 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-703715c4-3ae5-46a7-a100-cb97ba6a8492 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:13.102217 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-703715c4-3ae5-46a7-a100-cb97ba6a8492 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:13.108621 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-703715c4-3ae5-46a7-a100-cb97ba6a8492 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:13.114664 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-703715c4-3ae5-46a7-a100-cb97ba6a8492 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:13.114664 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-703715c4-3ae5-46a7-a100-cb97ba6a8492 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:13.114664 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-703715c4-3ae5-46a7-a100-cb97ba6a8492 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:13.114664 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-703715c4-3ae5-46a7-a100-cb97ba6a8492 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:13.116658 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-703715c4-3ae5-46a7-a100-cb97ba6a8492 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:13.140215 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1744538237", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "networks": [{"uuid": "c57b6d57-3ae8-455b-abd3-dde4328acea3"}]}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:51:13.208589 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.network.neutron [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] validate_networks() for [('c57b6d57-3ae8-455b-abd3-dde4328acea3', None, None, None, None, None)] {{(pid=127882) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:51:13.266066 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-703715c4-3ae5-46a7-a100-cb97ba6a8492 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:13.275291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-703715c4-3ae5-46a7-a100-cb97ba6a8492 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.177634 Aug 29 21:51:13.275883 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 45/91] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:13 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:13.747994 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Flavor limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:51:13.749088 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Image limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:51:13.749738 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Flavor pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:51:13.750187 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Image pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:51:13.750806 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:51:13.761782 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:13.762229 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:13.762843 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:13.763841 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:13.764303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:13.764943 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:13.786973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Getting quotas for project 91575ac1354247dca14aff7bbfe5d111. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:51:13.794135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Getting quotas for user ad1787af22c94bc8a3599abf7e8fbe39 and project 91575ac1354247dca14aff7bbfe5d111. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:51:13.797792 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2697a5aa-65f7-4559-8c61-4d82ac086439 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:13.798500 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2697a5aa-65f7-4559-8c61-4d82ac086439 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:13.807789 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2697a5aa-65f7-4559-8c61-4d82ac086439 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:13.808284 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2697a5aa-65f7-4559-8c61-4d82ac086439 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:13.809902 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2697a5aa-65f7-4559-8c61-4d82ac086439 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:13.810726 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2697a5aa-65f7-4559-8c61-4d82ac086439 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:13.811211 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2697a5aa-65f7-4559-8c61-4d82ac086439 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:13.811643 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2697a5aa-65f7-4559-8c61-4d82ac086439 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:13.818911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Going to run 1 instances... {{(pid=127882) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:51:13.823384 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127882) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:51:13.988504 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2697a5aa-65f7-4559-8c61-4d82ac086439 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:13.997446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2697a5aa-65f7-4559-8c61-4d82ac086439 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.205677 Aug 29 21:51:13.998305 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 46/92] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:13 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:14.098592 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6e11921d-03dd-47ec-ad9a-4e1083749581 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:14.099209 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6e11921d-03dd-47ec-ad9a-4e1083749581 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:14.105337 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e11921d-03dd-47ec-ad9a-4e1083749581 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:14.105828 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e11921d-03dd-47ec-ad9a-4e1083749581 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:14.106272 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e11921d-03dd-47ec-ad9a-4e1083749581 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:14.106971 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e11921d-03dd-47ec-ad9a-4e1083749581 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:14.107463 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e11921d-03dd-47ec-ad9a-4e1083749581 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:14.107890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e11921d-03dd-47ec-ad9a-4e1083749581 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:14.245352 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6e11921d-03dd-47ec-ad9a-4e1083749581 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:14.254539 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6e11921d-03dd-47ec-ad9a-4e1083749581 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:14.257685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6e11921d-03dd-47ec-ad9a-4e1083749581 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:14.257685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6e11921d-03dd-47ec-ad9a-4e1083749581 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.162617 Aug 29 21:51:14.257685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 47/93] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:14 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:51:14.297948 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-553dac45-f071-493a-b6ec-d4e27aab5b43 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:14.298561 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-553dac45-f071-493a-b6ec-d4e27aab5b43 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:14.304852 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-553dac45-f071-493a-b6ec-d4e27aab5b43 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:14.305338 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-553dac45-f071-493a-b6ec-d4e27aab5b43 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:14.305845 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-553dac45-f071-493a-b6ec-d4e27aab5b43 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:14.306560 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-553dac45-f071-493a-b6ec-d4e27aab5b43 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:14.307025 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-553dac45-f071-493a-b6ec-d4e27aab5b43 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:14.307446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-553dac45-f071-493a-b6ec-d4e27aab5b43 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:14.434295 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-caa9003c-d014-44cb-955f-01e0dbcf2836 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.453275 Aug 29 21:51:14.435068 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 47/94] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:51:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:51:14.454854 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-553dac45-f071-493a-b6ec-d4e27aab5b43 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:14.460028 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a88cf9ba-602e-43ee-884f-64e31e939d46 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:14.460800 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a88cf9ba-602e-43ee-884f-64e31e939d46 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:14.465936 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-553dac45-f071-493a-b6ec-d4e27aab5b43 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.172551 Aug 29 21:51:14.476272 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 48/95] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:14 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:14.535950 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a88cf9ba-602e-43ee-884f-64e31e939d46 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:14.543345 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a88cf9ba-602e-43ee-884f-64e31e939d46 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1214 microversion: 2.1 time: 0.087602 Aug 29 21:51:14.543937 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 48/96] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:14 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:15.022808 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b6a88a3f-ab1f-4f7b-92b4-aff566083897 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:15.023409 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b6a88a3f-ab1f-4f7b-92b4-aff566083897 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:15.029593 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6a88a3f-ab1f-4f7b-92b4-aff566083897 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:15.030075 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6a88a3f-ab1f-4f7b-92b4-aff566083897 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:15.030507 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6a88a3f-ab1f-4f7b-92b4-aff566083897 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:15.031232 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6a88a3f-ab1f-4f7b-92b4-aff566083897 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:15.031674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6a88a3f-ab1f-4f7b-92b4-aff566083897 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:15.032094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6a88a3f-ab1f-4f7b-92b4-aff566083897 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:15.180102 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b6a88a3f-ab1f-4f7b-92b4-aff566083897 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:15.201417 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b6a88a3f-ab1f-4f7b-92b4-aff566083897 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.182413 Aug 29 21:51:15.202260 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 49/97] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:15 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:15.281009 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e5f18626-6109-4e05-9684-fab1f20329af tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:15.281622 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-e5f18626-6109-4e05-9684-fab1f20329af tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:15.287766 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5f18626-6109-4e05-9684-fab1f20329af tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:15.288248 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5f18626-6109-4e05-9684-fab1f20329af tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:15.288710 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5f18626-6109-4e05-9684-fab1f20329af tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:15.289406 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5f18626-6109-4e05-9684-fab1f20329af tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:15.289852 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5f18626-6109-4e05-9684-fab1f20329af tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:15.290273 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5f18626-6109-4e05-9684-fab1f20329af tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:15.445515 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e5f18626-6109-4e05-9684-fab1f20329af tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:15.455172 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e5f18626-6109-4e05-9684-fab1f20329af tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:15.462378 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e5f18626-6109-4e05-9684-fab1f20329af tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:15.462378 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e5f18626-6109-4e05-9684-fab1f20329af tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.181586 Aug 29 21:51:15.462378 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 49/98] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:15 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:51:15.490108 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e4e291a9-5fa9-4483-bcb3-82af79aa3c59 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:15.491025 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e4e291a9-5fa9-4483-bcb3-82af79aa3c59 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:15.499742 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e4e291a9-5fa9-4483-bcb3-82af79aa3c59 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:15.500197 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e4e291a9-5fa9-4483-bcb3-82af79aa3c59 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:15.500785 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e4e291a9-5fa9-4483-bcb3-82af79aa3c59 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:15.501622 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e4e291a9-5fa9-4483-bcb3-82af79aa3c59 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:15.510997 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e4e291a9-5fa9-4483-bcb3-82af79aa3c59 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:15.510997 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e4e291a9-5fa9-4483-bcb3-82af79aa3c59 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:15.568361 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e911b2ff-37f0-4123-b231-b41f1edd644a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:15.568361 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-e911b2ff-37f0-4123-b231-b41f1edd644a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:15.661416 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e911b2ff-37f0-4123-b231-b41f1edd644a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:15.679770 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e911b2ff-37f0-4123-b231-b41f1edd644a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1214 microversion: 2.1 time: 0.118885 Aug 29 21:51:15.681810 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 50/99] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:15 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:15.711125 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e4e291a9-5fa9-4483-bcb3-82af79aa3c59 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:15.717954 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e4e291a9-5fa9-4483-bcb3-82af79aa3c59 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.232510 Aug 29 21:51:15.718545 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 50/100] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:15 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:16.225898 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d63b732f-c9d3-4cb8-b816-b7ffb165c9b4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:16.226874 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d63b732f-c9d3-4cb8-b816-b7ffb165c9b4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:16.234600 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d63b732f-c9d3-4cb8-b816-b7ffb165c9b4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:16.235125 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d63b732f-c9d3-4cb8-b816-b7ffb165c9b4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:16.235567 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d63b732f-c9d3-4cb8-b816-b7ffb165c9b4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:16.236338 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d63b732f-c9d3-4cb8-b816-b7ffb165c9b4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:16.236913 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d63b732f-c9d3-4cb8-b816-b7ffb165c9b4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:16.237397 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d63b732f-c9d3-4cb8-b816-b7ffb165c9b4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:16.387553 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d63b732f-c9d3-4cb8-b816-b7ffb165c9b4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:16.395988 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d63b732f-c9d3-4cb8-b816-b7ffb165c9b4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.175215 Aug 29 21:51:16.396593 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 51/101] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:16 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:16.486574 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2dc0737e-e69c-4dc0-b4d4-ea6ad4dc22cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:16.495398 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2dc0737e-e69c-4dc0-b4d4-ea6ad4dc22cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:16.495931 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2dc0737e-e69c-4dc0-b4d4-ea6ad4dc22cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:16.496354 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2dc0737e-e69c-4dc0-b4d4-ea6ad4dc22cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:16.497711 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2dc0737e-e69c-4dc0-b4d4-ea6ad4dc22cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:16.499182 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2dc0737e-e69c-4dc0-b4d4-ea6ad4dc22cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:16.499687 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2dc0737e-e69c-4dc0-b4d4-ea6ad4dc22cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:16.500106 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2dc0737e-e69c-4dc0-b4d4-ea6ad4dc22cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:16.669758 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2dc0737e-e69c-4dc0-b4d4-ea6ad4dc22cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:16.679115 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2dc0737e-e69c-4dc0-b4d4-ea6ad4dc22cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:16.686363 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2dc0737e-e69c-4dc0-b4d4-ea6ad4dc22cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:16.686363 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2dc0737e-e69c-4dc0-b4d4-ea6ad4dc22cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.199629 Aug 29 21:51:16.686363 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 51/102] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:16 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:51:16.702151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5778e5c9-08fb-41d0-b863-3be841887790 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:16.702754 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5778e5c9-08fb-41d0-b863-3be841887790 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:16.740200 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-40738800-0b8d-4e9e-bee2-2405f846bb48 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:16.740954 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-40738800-0b8d-4e9e-bee2-2405f846bb48 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:16.748338 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-40738800-0b8d-4e9e-bee2-2405f846bb48 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:16.749873 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-40738800-0b8d-4e9e-bee2-2405f846bb48 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:16.750481 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-40738800-0b8d-4e9e-bee2-2405f846bb48 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:16.751349 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-40738800-0b8d-4e9e-bee2-2405f846bb48 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:16.751966 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-40738800-0b8d-4e9e-bee2-2405f846bb48 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:16.752621 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-40738800-0b8d-4e9e-bee2-2405f846bb48 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:16.772688 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5778e5c9-08fb-41d0-b863-3be841887790 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:16.772688 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5778e5c9-08fb-41d0-b863-3be841887790 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1214 microversion: 2.1 time: 0.074880 Aug 29 21:51:16.773785 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 52/103] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:16 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:16.975131 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-40738800-0b8d-4e9e-bee2-2405f846bb48 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:16.984472 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-40738800-0b8d-4e9e-bee2-2405f846bb48 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.248892 Aug 29 21:51:16.985663 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 52/104] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:16 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:17.421599 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-08698382-7768-4c56-a3b2-2a096d02dbb2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:17.423294 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-08698382-7768-4c56-a3b2-2a096d02dbb2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:17.428585 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-08698382-7768-4c56-a3b2-2a096d02dbb2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:17.429140 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-08698382-7768-4c56-a3b2-2a096d02dbb2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:17.429580 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-08698382-7768-4c56-a3b2-2a096d02dbb2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:17.430298 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-08698382-7768-4c56-a3b2-2a096d02dbb2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:17.432019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-08698382-7768-4c56-a3b2-2a096d02dbb2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:17.432019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-08698382-7768-4c56-a3b2-2a096d02dbb2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:17.599697 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-08698382-7768-4c56-a3b2-2a096d02dbb2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:17.607745 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-08698382-7768-4c56-a3b2-2a096d02dbb2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.190975 Aug 29 21:51:17.608309 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 53/105] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:17 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:17.708247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-bad5fd84-b830-4f9d-af1c-c416e8fbb637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:17.711385 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-bad5fd84-b830-4f9d-af1c-c416e8fbb637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:17.719566 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bad5fd84-b830-4f9d-af1c-c416e8fbb637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:17.720106 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bad5fd84-b830-4f9d-af1c-c416e8fbb637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:17.720611 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bad5fd84-b830-4f9d-af1c-c416e8fbb637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:17.721582 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bad5fd84-b830-4f9d-af1c-c416e8fbb637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:17.722220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bad5fd84-b830-4f9d-af1c-c416e8fbb637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:17.722910 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bad5fd84-b830-4f9d-af1c-c416e8fbb637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:17.801115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-31483d40-0f09-46b6-828d-c424b4d227ae tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:17.803577 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-31483d40-0f09-46b6-828d-c424b4d227ae tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:17.817871 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-31483d40-0f09-46b6-828d-c424b4d227ae tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:17.819249 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-31483d40-0f09-46b6-828d-c424b4d227ae tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:17.820584 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-31483d40-0f09-46b6-828d-c424b4d227ae tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:17.823821 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-31483d40-0f09-46b6-828d-c424b4d227ae tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:17.823821 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-31483d40-0f09-46b6-828d-c424b4d227ae tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:17.823821 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-31483d40-0f09-46b6-828d-c424b4d227ae tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:17.890745 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-bad5fd84-b830-4f9d-af1c-c416e8fbb637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:17.894450 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=100 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:17.900276 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-bad5fd84-b830-4f9d-af1c-c416e8fbb637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:17.901861 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-bad5fd84-b830-4f9d-af1c-c416e8fbb637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:17.903040 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-bad5fd84-b830-4f9d-af1c-c416e8fbb637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.200325 Aug 29 21:51:17.903628 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 53/106] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:17 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:51:17.933964 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-31483d40-0f09-46b6-828d-c424b4d227ae tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:17.944717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-31483d40-0f09-46b6-828d-c424b4d227ae tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1210 microversion: 2.1 time: 0.150087 Aug 29 21:51:17.945234 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 54/107] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:17 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1210 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:18.009120 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-df733286-b10b-4e46-a2c3-a523737138f1 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:18.010232 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-df733286-b10b-4e46-a2c3-a523737138f1 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:18.020161 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-df733286-b10b-4e46-a2c3-a523737138f1 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:18.024635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-df733286-b10b-4e46-a2c3-a523737138f1 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:18.024635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-df733286-b10b-4e46-a2c3-a523737138f1 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:18.024635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-df733286-b10b-4e46-a2c3-a523737138f1 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:18.024635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-df733286-b10b-4e46-a2c3-a523737138f1 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:18.025048 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-df733286-b10b-4e46-a2c3-a523737138f1 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:18.210572 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-df733286-b10b-4e46-a2c3-a523737138f1 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:18.222777 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-df733286-b10b-4e46-a2c3-a523737138f1 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.220170 Aug 29 21:51:18.233052 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 54/108] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:18 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:18.312891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-dc188a36-1b7e-4f0b-9327-a3447ec6986f req-187adfc3-a716-4c0d-a25a-8b7bc3ac2566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6226c525-5ef4-4f3e-b09d-b4c38b6bd367", "name": "network-vif-plugged", "status": "completed", "tag": "671a0014-dd0d-4ecc-9b85-607c479d6da5"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:51:18.322365 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-dc188a36-1b7e-4f0b-9327-a3447ec6986f req-187adfc3-a716-4c0d-a25a-8b7bc3ac2566 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:18.323533 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-dc188a36-1b7e-4f0b-9327-a3447ec6986f req-187adfc3-a716-4c0d-a25a-8b7bc3ac2566 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:18.323975 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-dc188a36-1b7e-4f0b-9327-a3447ec6986f req-187adfc3-a716-4c0d-a25a-8b7bc3ac2566 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:18.335713 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-dc188a36-1b7e-4f0b-9327-a3447ec6986f req-187adfc3-a716-4c0d-a25a-8b7bc3ac2566 service nova] Creating event network-vif-plugged:671a0014-dd0d-4ecc-9b85-607c479d6da5 for instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 on hv-cinder-85426 Aug 29 21:51:18.341163 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-dc188a36-1b7e-4f0b-9327-a3447ec6986f req-187adfc3-a716-4c0d-a25a-8b7bc3ac2566 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109594 Aug 29 21:51:18.342283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 55/109] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:51:18.634235 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7b4b34d4-cabb-4b86-8668-a54d26c2cdfd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:18.635377 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7b4b34d4-cabb-4b86-8668-a54d26c2cdfd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:18.642002 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7b4b34d4-cabb-4b86-8668-a54d26c2cdfd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:18.642729 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7b4b34d4-cabb-4b86-8668-a54d26c2cdfd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:18.643390 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7b4b34d4-cabb-4b86-8668-a54d26c2cdfd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:18.644084 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7b4b34d4-cabb-4b86-8668-a54d26c2cdfd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:18.644939 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7b4b34d4-cabb-4b86-8668-a54d26c2cdfd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:18.645515 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7b4b34d4-cabb-4b86-8668-a54d26c2cdfd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:18.800384 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7b4b34d4-cabb-4b86-8668-a54d26c2cdfd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:18.808592 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7b4b34d4-cabb-4b86-8668-a54d26c2cdfd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.182139 Aug 29 21:51:18.809190 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 55/110] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:18 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:18.928902 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f6abcdd5-8ef4-4a93-8bef-f91e95a6e12d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:18.930129 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f6abcdd5-8ef4-4a93-8bef-f91e95a6e12d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:18.945925 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6abcdd5-8ef4-4a93-8bef-f91e95a6e12d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:18.946442 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6abcdd5-8ef4-4a93-8bef-f91e95a6e12d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:18.946891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6abcdd5-8ef4-4a93-8bef-f91e95a6e12d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:18.948796 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6abcdd5-8ef4-4a93-8bef-f91e95a6e12d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:18.949485 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6abcdd5-8ef4-4a93-8bef-f91e95a6e12d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:18.952848 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6abcdd5-8ef4-4a93-8bef-f91e95a6e12d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:18.967015 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a0afd3c9-ef11-4718-8fe9-af46b0fafe3a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:18.968088 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a0afd3c9-ef11-4718-8fe9-af46b0fafe3a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:18.979559 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a0afd3c9-ef11-4718-8fe9-af46b0fafe3a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:18.980142 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a0afd3c9-ef11-4718-8fe9-af46b0fafe3a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:18.980892 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a0afd3c9-ef11-4718-8fe9-af46b0fafe3a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:18.981628 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a0afd3c9-ef11-4718-8fe9-af46b0fafe3a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:18.982123 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a0afd3c9-ef11-4718-8fe9-af46b0fafe3a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:18.982541 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a0afd3c9-ef11-4718-8fe9-af46b0fafe3a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:19.063927 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a0afd3c9-ef11-4718-8fe9-af46b0fafe3a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:19.074813 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a0afd3c9-ef11-4718-8fe9-af46b0fafe3a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1266 microversion: 2.1 time: 0.111288 Aug 29 21:51:19.075348 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 56/111] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:18 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:19.119771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f6abcdd5-8ef4-4a93-8bef-f91e95a6e12d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:19.132425 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f6abcdd5-8ef4-4a93-8bef-f91e95a6e12d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:19.134256 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f6abcdd5-8ef4-4a93-8bef-f91e95a6e12d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:19.135640 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f6abcdd5-8ef4-4a93-8bef-f91e95a6e12d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.213486 Aug 29 21:51:19.136770 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 56/112] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:18 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:51:19.247584 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-caf38594-8926-46b2-a82c-1d10a7e20423 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:19.248800 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-caf38594-8926-46b2-a82c-1d10a7e20423 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:19.273355 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-caf38594-8926-46b2-a82c-1d10a7e20423 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:19.274241 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-caf38594-8926-46b2-a82c-1d10a7e20423 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:19.276573 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-caf38594-8926-46b2-a82c-1d10a7e20423 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:19.280997 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-caf38594-8926-46b2-a82c-1d10a7e20423 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:19.281955 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-caf38594-8926-46b2-a82c-1d10a7e20423 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:19.282490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-caf38594-8926-46b2-a82c-1d10a7e20423 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:19.446329 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-caf38594-8926-46b2-a82c-1d10a7e20423 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:19.455392 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-caf38594-8926-46b2-a82c-1d10a7e20423 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.212145 Aug 29 21:51:19.455976 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 57/113] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:19 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:19.839836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-1f13b21a-5c28-4ddf-a828-d5c9b993c117 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:19.841275 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-1f13b21a-5c28-4ddf-a828-d5c9b993c117 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:19.857176 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f13b21a-5c28-4ddf-a828-d5c9b993c117 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:19.858485 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f13b21a-5c28-4ddf-a828-d5c9b993c117 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:19.860215 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f13b21a-5c28-4ddf-a828-d5c9b993c117 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:19.861706 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f13b21a-5c28-4ddf-a828-d5c9b993c117 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:19.862723 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f13b21a-5c28-4ddf-a828-d5c9b993c117 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:19.863677 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f13b21a-5c28-4ddf-a828-d5c9b993c117 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:20.067095 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1f13b21a-5c28-4ddf-a828-d5c9b993c117 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:20.075623 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-1f13b21a-5c28-4ddf-a828-d5c9b993c117 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.247436 Aug 29 21:51:20.076237 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 57/114] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:19 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:20.097554 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-671070a1-a662-418f-a9c1-959992b05d7a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:20.098168 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-671070a1-a662-418f-a9c1-959992b05d7a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:20.106611 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-671070a1-a662-418f-a9c1-959992b05d7a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:20.109892 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-671070a1-a662-418f-a9c1-959992b05d7a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:20.109892 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-671070a1-a662-418f-a9c1-959992b05d7a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:20.109892 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-671070a1-a662-418f-a9c1-959992b05d7a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:20.109892 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-671070a1-a662-418f-a9c1-959992b05d7a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:20.125922 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-671070a1-a662-418f-a9c1-959992b05d7a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:20.160218 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-aad971c9-66ce-4850-9a6d-40bc6e26acf7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:20.165398 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-aad971c9-66ce-4850-9a6d-40bc6e26acf7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:20.167298 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aad971c9-66ce-4850-9a6d-40bc6e26acf7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:20.167787 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aad971c9-66ce-4850-9a6d-40bc6e26acf7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:20.168222 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aad971c9-66ce-4850-9a6d-40bc6e26acf7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:20.168966 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aad971c9-66ce-4850-9a6d-40bc6e26acf7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:20.169456 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aad971c9-66ce-4850-9a6d-40bc6e26acf7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:20.170508 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aad971c9-66ce-4850-9a6d-40bc6e26acf7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:20.179466 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-671070a1-a662-418f-a9c1-959992b05d7a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:20.191634 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-671070a1-a662-418f-a9c1-959992b05d7a tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1272 microversion: 2.1 time: 0.097141 Aug 29 21:51:20.207735 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 58/115] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:20 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:20.360390 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-f45328e8-c956-43e8-8ada-97060c525eba req-b3334ce9-2008-47dc-b7a7-9d6e8319f451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e60ebcd-98c1-4442-9c72-f4d9760c8d6f", "name": "network-vif-plugged", "status": "completed", "tag": "b49d987f-0fff-47f7-acee-6d31bbdeab4b"}, {"server_uuid": "93cc4db2-465f-41c0-8689-d78cccae7601", "name": "network-vif-plugged", "status": "completed", "tag": "863a5e0b-36a2-41bd-97bc-0a4f754bad9b"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:51:20.380638 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-f45328e8-c956-43e8-8ada-97060c525eba req-b3334ce9-2008-47dc-b7a7-9d6e8319f451 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:20.381388 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-f45328e8-c956-43e8-8ada-97060c525eba req-b3334ce9-2008-47dc-b7a7-9d6e8319f451 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:20.381832 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-f45328e8-c956-43e8-8ada-97060c525eba req-b3334ce9-2008-47dc-b7a7-9d6e8319f451 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:20.396927 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-aad971c9-66ce-4850-9a6d-40bc6e26acf7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:20.406197 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-f45328e8-c956-43e8-8ada-97060c525eba req-b3334ce9-2008-47dc-b7a7-9d6e8319f451 service nova] Creating event network-vif-plugged:b49d987f-0fff-47f7-acee-6d31bbdeab4b for instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f on hv-cinder-85426 Aug 29 21:51:20.412043 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-f45328e8-c956-43e8-8ada-97060c525eba req-b3334ce9-2008-47dc-b7a7-9d6e8319f451 service nova] Creating event network-vif-plugged:863a5e0b-36a2-41bd-97bc-0a4f754bad9b for instance 93cc4db2-465f-41c0-8689-d78cccae7601 on hv-cinder-85426 Aug 29 21:51:20.412043 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-f45328e8-c956-43e8-8ada-97060c525eba req-b3334ce9-2008-47dc-b7a7-9d6e8319f451 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 21:51:20.412043 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-f45328e8-c956-43e8-8ada-97060c525eba req-b3334ce9-2008-47dc-b7a7-9d6e8319f451 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 21:51:20.412043 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-842260a8-266e-4258-9c68-31fc6bcaae0d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:20.412043 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-842260a8-266e-4258-9c68-31fc6bcaae0d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:20.412546 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-aad971c9-66ce-4850-9a6d-40bc6e26acf7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:20.412713 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-842260a8-266e-4258-9c68-31fc6bcaae0d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:20.412713 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-842260a8-266e-4258-9c68-31fc6bcaae0d None None] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:20.412713 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-842260a8-266e-4258-9c68-31fc6bcaae0d None None] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:20.413023 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-aad971c9-66ce-4850-9a6d-40bc6e26acf7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:20.413196 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-842260a8-266e-4258-9c68-31fc6bcaae0d None None] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:20.413319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-aad971c9-66ce-4850-9a6d-40bc6e26acf7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.255905 Aug 29 21:51:20.421212 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.compute.rpcapi [None req-842260a8-266e-4258-9c68-31fc6bcaae0d None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 21:51:20.422097 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-842260a8-266e-4258-9c68-31fc6bcaae0d None None] Releasing lock "compute-rpcapi-router" {{(pid=127883) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 21:51:20.422998 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 58/116] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:20 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:51:20.440045 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-842260a8-266e-4258-9c68-31fc6bcaae0d None None] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086541 Aug 29 21:51:20.441503 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 59/117] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:51:20.477691 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2ec3d0f9-dcd0-49b8-a675-437cbc63d05a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:20.480378 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2ec3d0f9-dcd0-49b8-a675-437cbc63d05a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:20.490022 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ec3d0f9-dcd0-49b8-a675-437cbc63d05a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:20.490594 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ec3d0f9-dcd0-49b8-a675-437cbc63d05a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:20.491046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ec3d0f9-dcd0-49b8-a675-437cbc63d05a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:20.491764 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ec3d0f9-dcd0-49b8-a675-437cbc63d05a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:20.492214 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ec3d0f9-dcd0-49b8-a675-437cbc63d05a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:20.492787 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ec3d0f9-dcd0-49b8-a675-437cbc63d05a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:20.746329 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2ec3d0f9-dcd0-49b8-a675-437cbc63d05a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:20.764772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2ec3d0f9-dcd0-49b8-a675-437cbc63d05a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.290528 Aug 29 21:51:20.766568 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 59/118] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:20 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:21.097608 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-674a1b4b-026c-47e9-acd9-bfe5407ca2db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:21.105844 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-674a1b4b-026c-47e9-acd9-bfe5407ca2db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:21.125362 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-674a1b4b-026c-47e9-acd9-bfe5407ca2db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:21.126506 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-674a1b4b-026c-47e9-acd9-bfe5407ca2db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:21.127162 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-674a1b4b-026c-47e9-acd9-bfe5407ca2db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:21.130910 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-674a1b4b-026c-47e9-acd9-bfe5407ca2db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:21.133820 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-674a1b4b-026c-47e9-acd9-bfe5407ca2db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:21.134662 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-674a1b4b-026c-47e9-acd9-bfe5407ca2db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:21.215361 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-aa586150-a19d-4522-a192-467d1c856710 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:21.215988 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-aa586150-a19d-4522-a192-467d1c856710 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:21.235775 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aa586150-a19d-4522-a192-467d1c856710 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:21.236283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aa586150-a19d-4522-a192-467d1c856710 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:21.236756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aa586150-a19d-4522-a192-467d1c856710 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:21.237474 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aa586150-a19d-4522-a192-467d1c856710 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:21.237933 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aa586150-a19d-4522-a192-467d1c856710 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:21.238406 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aa586150-a19d-4522-a192-467d1c856710 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:21.385684 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-674a1b4b-026c-47e9-acd9-bfe5407ca2db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:21.412812 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-674a1b4b-026c-47e9-acd9-bfe5407ca2db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.304949 Aug 29 21:51:21.412812 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 60/119] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:21 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:21.444296 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0dbeb1b6-079c-43dd-b4af-1f2b2b2ff065 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:21.445507 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0dbeb1b6-079c-43dd-b4af-1f2b2b2ff065 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:21.454597 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0dbeb1b6-079c-43dd-b4af-1f2b2b2ff065 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:21.455518 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0dbeb1b6-079c-43dd-b4af-1f2b2b2ff065 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:21.459995 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0dbeb1b6-079c-43dd-b4af-1f2b2b2ff065 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:21.459995 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0dbeb1b6-079c-43dd-b4af-1f2b2b2ff065 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:21.459995 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0dbeb1b6-079c-43dd-b4af-1f2b2b2ff065 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:21.459995 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0dbeb1b6-079c-43dd-b4af-1f2b2b2ff065 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:21.569098 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-aa586150-a19d-4522-a192-467d1c856710 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:21.586299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-aa586150-a19d-4522-a192-467d1c856710 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1314 microversion: 2.1 time: 0.374516 Aug 29 21:51:21.590354 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 60/120] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:21 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:21.709460 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0dbeb1b6-079c-43dd-b4af-1f2b2b2ff065 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:21.726240 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0dbeb1b6-079c-43dd-b4af-1f2b2b2ff065 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:21.728220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0dbeb1b6-079c-43dd-b4af-1f2b2b2ff065 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:21.729770 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0dbeb1b6-079c-43dd-b4af-1f2b2b2ff065 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.295743 Aug 29 21:51:21.730631 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 61/121] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:21 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:51:21.756376 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-fdc34800-4df1-4344-b4e0-821e7701ec1d req-2d4c45b3-68bd-49f1-9e6a-820c23434e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5164e3ed-1070-403d-8a4c-fc44b15b4a17", "tag": "b888e935-f438-4e47-b7be-475f31967df3"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:51:21.768343 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-fdc34800-4df1-4344-b4e0-821e7701ec1d req-2d4c45b3-68bd-49f1-9e6a-820c23434e22 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:21.778785 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-fdc34800-4df1-4344-b4e0-821e7701ec1d req-2d4c45b3-68bd-49f1-9e6a-820c23434e22 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:21.778785 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-fdc34800-4df1-4344-b4e0-821e7701ec1d req-2d4c45b3-68bd-49f1-9e6a-820c23434e22 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:21.782975 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-fdc34800-4df1-4344-b4e0-821e7701ec1d req-2d4c45b3-68bd-49f1-9e6a-820c23434e22 service nova] Creating event network-changed:b888e935-f438-4e47-b7be-475f31967df3 for instance 5164e3ed-1070-403d-8a4c-fc44b15b4a17 on hv-cinder-85426 Aug 29 21:51:21.789945 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-fdc34800-4df1-4344-b4e0-821e7701ec1d req-2d4c45b3-68bd-49f1-9e6a-820c23434e22 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037240 Aug 29 21:51:21.790800 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 61/122] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:51:21.807920 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-af0e7311-1216-4659-9796-1e3430e65606 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:21.808603 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-af0e7311-1216-4659-9796-1e3430e65606 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:21.815937 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-af0e7311-1216-4659-9796-1e3430e65606 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:21.816348 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-af0e7311-1216-4659-9796-1e3430e65606 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:21.816814 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-af0e7311-1216-4659-9796-1e3430e65606 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:21.817558 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-af0e7311-1216-4659-9796-1e3430e65606 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:21.818026 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-af0e7311-1216-4659-9796-1e3430e65606 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:21.818465 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-af0e7311-1216-4659-9796-1e3430e65606 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:22.006905 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-af0e7311-1216-4659-9796-1e3430e65606 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:22.022107 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-af0e7311-1216-4659-9796-1e3430e65606 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1315 microversion: 2.1 time: 0.217737 Aug 29 21:51:22.023065 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 62/123] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:21 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:22.420159 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-52a4701e-df91-47b3-b32e-d49897e3837f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:22.420896 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-52a4701e-df91-47b3-b32e-d49897e3837f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:22.427708 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-52a4701e-df91-47b3-b32e-d49897e3837f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:22.428209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-52a4701e-df91-47b3-b32e-d49897e3837f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:22.428689 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-52a4701e-df91-47b3-b32e-d49897e3837f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:22.429395 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-52a4701e-df91-47b3-b32e-d49897e3837f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:22.429853 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-52a4701e-df91-47b3-b32e-d49897e3837f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:22.430289 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-52a4701e-df91-47b3-b32e-d49897e3837f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:22.576143 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-52a4701e-df91-47b3-b32e-d49897e3837f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:22.584114 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-52a4701e-df91-47b3-b32e-d49897e3837f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.168402 Aug 29 21:51:22.598298 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 62/124] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:22 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:22.611697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a2f7d621-1b48-4da4-b2f0-17ac2d50752b tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:22.612299 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a2f7d621-1b48-4da4-b2f0-17ac2d50752b tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:22.620980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a2f7d621-1b48-4da4-b2f0-17ac2d50752b tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:22.620980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a2f7d621-1b48-4da4-b2f0-17ac2d50752b tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:22.620980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a2f7d621-1b48-4da4-b2f0-17ac2d50752b tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:22.620980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a2f7d621-1b48-4da4-b2f0-17ac2d50752b tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:22.621398 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a2f7d621-1b48-4da4-b2f0-17ac2d50752b tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:22.621398 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a2f7d621-1b48-4da4-b2f0-17ac2d50752b tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:22.756669 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e7d4ca29-9db2-4b42-af7b-e13cb4748698 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:22.757341 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-e7d4ca29-9db2-4b42-af7b-e13cb4748698 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:22.763899 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e7d4ca29-9db2-4b42-af7b-e13cb4748698 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:22.764524 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e7d4ca29-9db2-4b42-af7b-e13cb4748698 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:22.764899 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e7d4ca29-9db2-4b42-af7b-e13cb4748698 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:22.765628 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e7d4ca29-9db2-4b42-af7b-e13cb4748698 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:22.766094 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e7d4ca29-9db2-4b42-af7b-e13cb4748698 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:22.766580 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e7d4ca29-9db2-4b42-af7b-e13cb4748698 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:22.768944 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a2f7d621-1b48-4da4-b2f0-17ac2d50752b tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:22.777001 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a2f7d621-1b48-4da4-b2f0-17ac2d50752b tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1314 microversion: 2.1 time: 0.169030 Aug 29 21:51:22.777588 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 63/125] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:22 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:22.938708 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e7d4ca29-9db2-4b42-af7b-e13cb4748698 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:22.951276 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e7d4ca29-9db2-4b42-af7b-e13cb4748698 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:22.952779 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e7d4ca29-9db2-4b42-af7b-e13cb4748698 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:22.953982 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e7d4ca29-9db2-4b42-af7b-e13cb4748698 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.201492 Aug 29 21:51:22.954536 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 63/126] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:22 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:51:23.052896 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e1598826-9ec1-4a9b-8dba-d762f3e4ef09 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:23.055539 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e1598826-9ec1-4a9b-8dba-d762f3e4ef09 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:23.061228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e1598826-9ec1-4a9b-8dba-d762f3e4ef09 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:23.062158 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e1598826-9ec1-4a9b-8dba-d762f3e4ef09 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:23.062734 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e1598826-9ec1-4a9b-8dba-d762f3e4ef09 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:23.063626 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e1598826-9ec1-4a9b-8dba-d762f3e4ef09 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:23.064329 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e1598826-9ec1-4a9b-8dba-d762f3e4ef09 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:23.065363 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e1598826-9ec1-4a9b-8dba-d762f3e4ef09 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:23.210399 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e1598826-9ec1-4a9b-8dba-d762f3e4ef09 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:23.218923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e1598826-9ec1-4a9b-8dba-d762f3e4ef09 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1503 microversion: 2.1 time: 0.174720 Aug 29 21:51:23.219485 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 64/127] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:23 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:23.607151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-016393c7-093e-454a-8f7b-2fbe1a1457bf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:23.607843 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-016393c7-093e-454a-8f7b-2fbe1a1457bf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:23.614170 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-016393c7-093e-454a-8f7b-2fbe1a1457bf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:23.614660 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-016393c7-093e-454a-8f7b-2fbe1a1457bf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:23.615094 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-016393c7-093e-454a-8f7b-2fbe1a1457bf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:23.617091 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-016393c7-093e-454a-8f7b-2fbe1a1457bf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:23.617091 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-016393c7-093e-454a-8f7b-2fbe1a1457bf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:23.617091 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-016393c7-093e-454a-8f7b-2fbe1a1457bf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:23.771507 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-016393c7-093e-454a-8f7b-2fbe1a1457bf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:23.773919 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=2 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:23.781273 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-016393c7-093e-454a-8f7b-2fbe1a1457bf tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1361 microversion: 2.1 time: 0.178236 Aug 29 21:51:23.781911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 64/128] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:23 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:23.813501 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d4661a29-8e2b-4e1b-b2ad-8ab7103f8cb1 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:23.814117 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d4661a29-8e2b-4e1b-b2ad-8ab7103f8cb1 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:23.820329 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d4661a29-8e2b-4e1b-b2ad-8ab7103f8cb1 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:23.820867 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d4661a29-8e2b-4e1b-b2ad-8ab7103f8cb1 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:23.821321 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d4661a29-8e2b-4e1b-b2ad-8ab7103f8cb1 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:23.822054 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d4661a29-8e2b-4e1b-b2ad-8ab7103f8cb1 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:23.822515 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d4661a29-8e2b-4e1b-b2ad-8ab7103f8cb1 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:23.822960 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d4661a29-8e2b-4e1b-b2ad-8ab7103f8cb1 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:23.974435 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d4661a29-8e2b-4e1b-b2ad-8ab7103f8cb1 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:23.978458 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-12377e94-6ad2-4ffc-b5e9-f530e36f020f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:23.979375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-12377e94-6ad2-4ffc-b5e9-f530e36f020f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:23.986031 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12377e94-6ad2-4ffc-b5e9-f530e36f020f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:23.986620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12377e94-6ad2-4ffc-b5e9-f530e36f020f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:23.986752 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d4661a29-8e2b-4e1b-b2ad-8ab7103f8cb1 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1314 microversion: 2.1 time: 0.177452 Aug 29 21:51:23.987360 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12377e94-6ad2-4ffc-b5e9-f530e36f020f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:23.987624 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 65/129] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:23 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:23.988553 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12377e94-6ad2-4ffc-b5e9-f530e36f020f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:23.989298 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12377e94-6ad2-4ffc-b5e9-f530e36f020f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:23.989730 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12377e94-6ad2-4ffc-b5e9-f530e36f020f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:24.007948 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=100 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:24.171165 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-12377e94-6ad2-4ffc-b5e9-f530e36f020f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:24.181576 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-12377e94-6ad2-4ffc-b5e9-f530e36f020f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:24.183670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-12377e94-6ad2-4ffc-b5e9-f530e36f020f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:24.193157 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-12377e94-6ad2-4ffc-b5e9-f530e36f020f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1406 microversion: 2.20 time: 0.218569 Aug 29 21:51:24.193763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 65/130] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:23 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:51:24.805382 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-58dae725-c50f-4a6e-9386-a4bd7bfe471b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:24.806033 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-58dae725-c50f-4a6e-9386-a4bd7bfe471b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:24.814796 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58dae725-c50f-4a6e-9386-a4bd7bfe471b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:24.815438 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58dae725-c50f-4a6e-9386-a4bd7bfe471b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:24.815713 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58dae725-c50f-4a6e-9386-a4bd7bfe471b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:24.816411 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58dae725-c50f-4a6e-9386-a4bd7bfe471b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:24.816932 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58dae725-c50f-4a6e-9386-a4bd7bfe471b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:24.817383 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58dae725-c50f-4a6e-9386-a4bd7bfe471b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:24.957020 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-58dae725-c50f-4a6e-9386-a4bd7bfe471b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:24.965634 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-58dae725-c50f-4a6e-9386-a4bd7bfe471b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1547 microversion: 2.1 time: 0.164271 Aug 29 21:51:24.967628 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 66/131] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:24 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:24.987664 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ca13643e-bbc6-4129-ae90-93c3db116f51 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:24.988231 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ca13643e-bbc6-4129-ae90-93c3db116f51 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:24.995184 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ca13643e-bbc6-4129-ae90-93c3db116f51 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:24.995184 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ca13643e-bbc6-4129-ae90-93c3db116f51 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:24.995610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ca13643e-bbc6-4129-ae90-93c3db116f51 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:24.996315 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ca13643e-bbc6-4129-ae90-93c3db116f51 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:24.996797 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ca13643e-bbc6-4129-ae90-93c3db116f51 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:24.997224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ca13643e-bbc6-4129-ae90-93c3db116f51 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:25.007839 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-cbd1dadc-d619-4ec7-ad2b-271dee05ef17 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:25.008461 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-cbd1dadc-d619-4ec7-ad2b-271dee05ef17 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:25.015688 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cbd1dadc-d619-4ec7-ad2b-271dee05ef17 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:25.016180 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cbd1dadc-d619-4ec7-ad2b-271dee05ef17 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:25.016667 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cbd1dadc-d619-4ec7-ad2b-271dee05ef17 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:25.017370 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cbd1dadc-d619-4ec7-ad2b-271dee05ef17 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:25.017831 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cbd1dadc-d619-4ec7-ad2b-271dee05ef17 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:25.020709 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cbd1dadc-d619-4ec7-ad2b-271dee05ef17 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:25.144550 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ca13643e-bbc6-4129-ae90-93c3db116f51 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160629 Aug 29 21:51:25.145145 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 66/132] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 21:51:24 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:51:25.182041 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-cbd1dadc-d619-4ec7-ad2b-271dee05ef17 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:25.187757 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-cbd1dadc-d619-4ec7-ad2b-271dee05ef17 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1314 microversion: 2.1 time: 0.183678 Aug 29 21:51:25.189085 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 67/133] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:25 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:25.216997 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-fc1f6247-d19e-4773-a297-83135d7fc9ac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:25.217621 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-fc1f6247-d19e-4773-a297-83135d7fc9ac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:25.224774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc1f6247-d19e-4773-a297-83135d7fc9ac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:25.225385 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc1f6247-d19e-4773-a297-83135d7fc9ac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:25.225870 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc1f6247-d19e-4773-a297-83135d7fc9ac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:25.226643 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc1f6247-d19e-4773-a297-83135d7fc9ac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:25.227670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc1f6247-d19e-4773-a297-83135d7fc9ac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:25.229404 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc1f6247-d19e-4773-a297-83135d7fc9ac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:25.994853 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-fc1f6247-d19e-4773-a297-83135d7fc9ac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:26.014113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-fc1f6247-d19e-4773-a297-83135d7fc9ac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:26.016985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-fc1f6247-d19e-4773-a297-83135d7fc9ac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:26.019006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-fc1f6247-d19e-4773-a297-83135d7fc9ac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1599 microversion: 2.20 time: 0.806133 Aug 29 21:51:26.035939 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 67/134] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:51:25 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1599 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:51:26.047190 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a7e6f0fc-b24a-4efc-a411-f6711ee3b683 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:26.048357 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a7e6f0fc-b24a-4efc-a411-f6711ee3b683 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:26.055131 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a7e6f0fc-b24a-4efc-a411-f6711ee3b683 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:26.058137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a7e6f0fc-b24a-4efc-a411-f6711ee3b683 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:26.058621 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a7e6f0fc-b24a-4efc-a411-f6711ee3b683 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:26.059364 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a7e6f0fc-b24a-4efc-a411-f6711ee3b683 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:26.060322 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a7e6f0fc-b24a-4efc-a411-f6711ee3b683 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:26.060779 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a7e6f0fc-b24a-4efc-a411-f6711ee3b683 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:26.211876 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a7e6f0fc-b24a-4efc-a411-f6711ee3b683 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.168957 Aug 29 21:51:26.212544 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 68/135] 10.222.0.83 () {60 vars in 1316 bytes} [Mon Aug 29 21:51:26 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:51:26.225593 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-1985a6b3-b311-492f-aec1-b5b447ea1779 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:26.226479 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-1985a6b3-b311-492f-aec1-b5b447ea1779 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:26.233238 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1985a6b3-b311-492f-aec1-b5b447ea1779 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:26.233977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1985a6b3-b311-492f-aec1-b5b447ea1779 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:26.235001 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1985a6b3-b311-492f-aec1-b5b447ea1779 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:26.236016 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1985a6b3-b311-492f-aec1-b5b447ea1779 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:26.236744 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1985a6b3-b311-492f-aec1-b5b447ea1779 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:26.237357 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1985a6b3-b311-492f-aec1-b5b447ea1779 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:26.348346 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-3244508d-48a3-4298-aa1c-83a13c726922 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "093ed3bb-5ea2-46c6-b762-e46db7ef6a2b"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:51:26.352094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-3244508d-48a3-4298-aa1c-83a13c726922 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:26.367084 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3244508d-48a3-4298-aa1c-83a13c726922 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:26.373865 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3244508d-48a3-4298-aa1c-83a13c726922 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:26.374475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3244508d-48a3-4298-aa1c-83a13c726922 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:26.375226 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3244508d-48a3-4298-aa1c-83a13c726922 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:26.375752 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3244508d-48a3-4298-aa1c-83a13c726922 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:26.376183 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3244508d-48a3-4298-aa1c-83a13c726922 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:26.769297 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=12 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:27.203690 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1985a6b3-b311-492f-aec1-b5b447ea1779 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:27.213192 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-1985a6b3-b311-492f-aec1-b5b447ea1779 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1314 microversion: 2.1 time: 0.991907 Aug 29 21:51:27.214198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 68/136] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:26 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1314 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:27.693364 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:27.877178 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-3244508d-48a3-4298-aa1c-83a13c726922 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "POST /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.533942 Aug 29 21:51:27.884010 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 69/137] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 21:51:26 2022] POST /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367/os-volume_attachments => generated 194 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:51:28.244006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-14ab4794-f99e-4d14-9abe-f122a4e8d9ce tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:28.245436 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-14ab4794-f99e-4d14-9abe-f122a4e8d9ce tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:28.262064 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14ab4794-f99e-4d14-9abe-f122a4e8d9ce tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:28.262161 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14ab4794-f99e-4d14-9abe-f122a4e8d9ce tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:28.262672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14ab4794-f99e-4d14-9abe-f122a4e8d9ce tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:28.270900 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14ab4794-f99e-4d14-9abe-f122a4e8d9ce tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:28.275060 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14ab4794-f99e-4d14-9abe-f122a4e8d9ce tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:28.275706 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14ab4794-f99e-4d14-9abe-f122a4e8d9ce tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:28.312067 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-f3a9fccf-3628-4398-acc2-242149cdaa01 req-3de9d4b9-6cc3-4cca-ba55-687fb2918335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93cc4db2-465f-41c0-8689-d78cccae7601", "tag": "863a5e0b-36a2-41bd-97bc-0a4f754bad9b"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:51:28.349083 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-f3a9fccf-3628-4398-acc2-242149cdaa01 req-3de9d4b9-6cc3-4cca-ba55-687fb2918335 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:28.349746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-f3a9fccf-3628-4398-acc2-242149cdaa01 req-3de9d4b9-6cc3-4cca-ba55-687fb2918335 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:28.350424 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-f3a9fccf-3628-4398-acc2-242149cdaa01 req-3de9d4b9-6cc3-4cca-ba55-687fb2918335 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:28.363548 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-f3a9fccf-3628-4398-acc2-242149cdaa01 req-3de9d4b9-6cc3-4cca-ba55-687fb2918335 service nova] Creating event network-changed:863a5e0b-36a2-41bd-97bc-0a4f754bad9b for instance 93cc4db2-465f-41c0-8689-d78cccae7601 on hv-cinder-85426 Aug 29 21:51:28.369193 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-f3a9fccf-3628-4398-acc2-242149cdaa01 req-3de9d4b9-6cc3-4cca-ba55-687fb2918335 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066964 Aug 29 21:51:28.370462 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 70/138] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:51:28.376644 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-9352f7e6-56fe-4190-bac5-2c2f4a44ade6 req-0514e654-4871-47af-9955-833228ae8e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e60ebcd-98c1-4442-9c72-f4d9760c8d6f", "tag": "b49d987f-0fff-47f7-acee-6d31bbdeab4b"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:51:28.390683 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-9352f7e6-56fe-4190-bac5-2c2f4a44ade6 req-0514e654-4871-47af-9955-833228ae8e12 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:28.395002 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-9352f7e6-56fe-4190-bac5-2c2f4a44ade6 req-0514e654-4871-47af-9955-833228ae8e12 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:28.395776 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-9352f7e6-56fe-4190-bac5-2c2f4a44ade6 req-0514e654-4871-47af-9955-833228ae8e12 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:28.411521 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-9352f7e6-56fe-4190-bac5-2c2f4a44ade6 req-0514e654-4871-47af-9955-833228ae8e12 service nova] Creating event network-changed:b49d987f-0fff-47f7-acee-6d31bbdeab4b for instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f on hv-cinder-85426 Aug 29 21:51:28.417112 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-9352f7e6-56fe-4190-bac5-2c2f4a44ade6 req-0514e654-4871-47af-9955-833228ae8e12 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045067 Aug 29 21:51:28.418602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 71/139] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:51:28.497756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-14ab4794-f99e-4d14-9abe-f122a4e8d9ce tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:28.510884 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-14ab4794-f99e-4d14-9abe-f122a4e8d9ce tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1314 microversion: 2.1 time: 0.279288 Aug 29 21:51:28.527001 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 69/140] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:28 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:29.537613 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-87c6609b-af33-4cb7-a894-c89b308b99c9 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:29.538967 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-87c6609b-af33-4cb7-a894-c89b308b99c9 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:29.549687 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87c6609b-af33-4cb7-a894-c89b308b99c9 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:29.550742 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87c6609b-af33-4cb7-a894-c89b308b99c9 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:29.551364 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87c6609b-af33-4cb7-a894-c89b308b99c9 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:29.553278 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87c6609b-af33-4cb7-a894-c89b308b99c9 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:29.553906 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87c6609b-af33-4cb7-a894-c89b308b99c9 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:29.554544 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87c6609b-af33-4cb7-a894-c89b308b99c9 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:29.730233 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-87c6609b-af33-4cb7-a894-c89b308b99c9 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:29.748603 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-87c6609b-af33-4cb7-a894-c89b308b99c9 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1314 microversion: 2.1 time: 0.218418 Aug 29 21:51:29.750296 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 72/141] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:29 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:30.770147 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-adb9819c-baf3-42b2-9240-bcf2fbabadde tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:30.770750 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-adb9819c-baf3-42b2-9240-bcf2fbabadde tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:30.777845 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-adb9819c-baf3-42b2-9240-bcf2fbabadde tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:30.778325 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-adb9819c-baf3-42b2-9240-bcf2fbabadde tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:30.778787 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-adb9819c-baf3-42b2-9240-bcf2fbabadde tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:30.779479 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-adb9819c-baf3-42b2-9240-bcf2fbabadde tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:30.779923 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-adb9819c-baf3-42b2-9240-bcf2fbabadde tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:30.780343 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-adb9819c-baf3-42b2-9240-bcf2fbabadde tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:31.343639 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-adb9819c-baf3-42b2-9240-bcf2fbabadde tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:31.352015 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-adb9819c-baf3-42b2-9240-bcf2fbabadde tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1314 microversion: 2.1 time: 0.585628 Aug 29 21:51:31.352630 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 70/142] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:30 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:32.382211 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7ec6efe3-7106-4312-90e6-dab66298283e tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:32.384738 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7ec6efe3-7106-4312-90e6-dab66298283e tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:32.388983 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:32.404424 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7ec6efe3-7106-4312-90e6-dab66298283e tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:32.404424 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7ec6efe3-7106-4312-90e6-dab66298283e tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:32.404424 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7ec6efe3-7106-4312-90e6-dab66298283e tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:32.406391 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7ec6efe3-7106-4312-90e6-dab66298283e tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:32.407452 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7ec6efe3-7106-4312-90e6-dab66298283e tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:32.408373 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7ec6efe3-7106-4312-90e6-dab66298283e tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:32.611858 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7ec6efe3-7106-4312-90e6-dab66298283e tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:32.624162 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7ec6efe3-7106-4312-90e6-dab66298283e tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1314 microversion: 2.1 time: 0.251811 Aug 29 21:51:32.625569 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 73/143] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:32 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:33.647350 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a5f4c807-f465-4b36-b537-97f50038ee30 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:33.648580 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a5f4c807-f465-4b36-b537-97f50038ee30 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:33.656470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a5f4c807-f465-4b36-b537-97f50038ee30 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:33.657093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a5f4c807-f465-4b36-b537-97f50038ee30 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:33.658207 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a5f4c807-f465-4b36-b537-97f50038ee30 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:33.658423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a5f4c807-f465-4b36-b537-97f50038ee30 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:33.659078 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a5f4c807-f465-4b36-b537-97f50038ee30 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:33.659685 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a5f4c807-f465-4b36-b537-97f50038ee30 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:33.811371 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a5f4c807-f465-4b36-b537-97f50038ee30 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:33.820931 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a5f4c807-f465-4b36-b537-97f50038ee30 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1314 microversion: 2.1 time: 0.177842 Aug 29 21:51:33.821602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 71/144] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:33 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:33.938194 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b6b6ea7f-5523-4b10-94a6-de79963d6c0c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:33.939304 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b6b6ea7f-5523-4b10-94a6-de79963d6c0c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:33.947811 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6b6ea7f-5523-4b10-94a6-de79963d6c0c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:33.948736 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6b6ea7f-5523-4b10-94a6-de79963d6c0c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:33.950207 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6b6ea7f-5523-4b10-94a6-de79963d6c0c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:33.951577 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6b6ea7f-5523-4b10-94a6-de79963d6c0c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:33.952683 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6b6ea7f-5523-4b10-94a6-de79963d6c0c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:33.953396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6b6ea7f-5523-4b10-94a6-de79963d6c0c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:33.993196 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b6b6ea7f-5523-4b10-94a6-de79963d6c0c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Going to try to terminate instance {{(pid=127883) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:51:34.201444 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-2e4fc6e4-337a-41e1-b4ef-19753eee60b7 req-d10c293d-5a9e-431a-8a35-c9a1cb854843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5164e3ed-1070-403d-8a4c-fc44b15b4a17", "name": "network-vif-plugged", "status": "completed", "tag": "b888e935-f438-4e47-b7be-475f31967df3"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:51:34.218847 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-2e4fc6e4-337a-41e1-b4ef-19753eee60b7 req-d10c293d-5a9e-431a-8a35-c9a1cb854843 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:34.219621 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-2e4fc6e4-337a-41e1-b4ef-19753eee60b7 req-d10c293d-5a9e-431a-8a35-c9a1cb854843 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:34.220378 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-2e4fc6e4-337a-41e1-b4ef-19753eee60b7 req-d10c293d-5a9e-431a-8a35-c9a1cb854843 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:34.241001 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-2e4fc6e4-337a-41e1-b4ef-19753eee60b7 req-d10c293d-5a9e-431a-8a35-c9a1cb854843 service nova] Creating event network-vif-plugged:b888e935-f438-4e47-b7be-475f31967df3 for instance 5164e3ed-1070-403d-8a4c-fc44b15b4a17 on hv-cinder-85426 Aug 29 21:51:34.247265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-2e4fc6e4-337a-41e1-b4ef-19753eee60b7 req-d10c293d-5a9e-431a-8a35-c9a1cb854843 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052723 Aug 29 21:51:34.247606 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 72/145] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:51:34.506259 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b6b6ea7f-5523-4b10-94a6-de79963d6c0c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 204 len: 0 microversion: 2.1 time: 0.572138 Aug 29 21:51:34.506955 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 74/146] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:51:33 2022] DELETE /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:51:34.521265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-13a153ba-fb84-4fbb-8af1-4f3e8f4be170 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:34.522526 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-13a153ba-fb84-4fbb-8af1-4f3e8f4be170 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:34.532132 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-13a153ba-fb84-4fbb-8af1-4f3e8f4be170 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:34.532362 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-13a153ba-fb84-4fbb-8af1-4f3e8f4be170 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:34.537506 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-13a153ba-fb84-4fbb-8af1-4f3e8f4be170 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:34.538263 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-13a153ba-fb84-4fbb-8af1-4f3e8f4be170 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:34.538756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-13a153ba-fb84-4fbb-8af1-4f3e8f4be170 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:34.539187 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-13a153ba-fb84-4fbb-8af1-4f3e8f4be170 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:34.690363 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-13a153ba-fb84-4fbb-8af1-4f3e8f4be170 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:34.701199 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-13a153ba-fb84-4fbb-8af1-4f3e8f4be170 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1555 microversion: 2.1 time: 0.188036 Aug 29 21:51:34.701792 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 73/147] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:34 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:34.844188 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a6ea346f-e8a5-4422-a4e7-973918ca5949 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:34.845027 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a6ea346f-e8a5-4422-a4e7-973918ca5949 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:34.854408 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a6ea346f-e8a5-4422-a4e7-973918ca5949 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:34.855142 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a6ea346f-e8a5-4422-a4e7-973918ca5949 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:34.855915 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a6ea346f-e8a5-4422-a4e7-973918ca5949 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:34.857214 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a6ea346f-e8a5-4422-a4e7-973918ca5949 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:34.857996 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a6ea346f-e8a5-4422-a4e7-973918ca5949 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:34.858748 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a6ea346f-e8a5-4422-a4e7-973918ca5949 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:35.028822 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a6ea346f-e8a5-4422-a4e7-973918ca5949 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:35.037468 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a6ea346f-e8a5-4422-a4e7-973918ca5949 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1314 microversion: 2.1 time: 0.198332 Aug 29 21:51:35.038181 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 75/148] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:34 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:35.723900 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-7a9495a1-3b71-4df6-81be-f1c45c3f0eab tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:35.724648 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-7a9495a1-3b71-4df6-81be-f1c45c3f0eab tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:35.735943 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7a9495a1-3b71-4df6-81be-f1c45c3f0eab tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:35.736437 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7a9495a1-3b71-4df6-81be-f1c45c3f0eab tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:35.736887 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7a9495a1-3b71-4df6-81be-f1c45c3f0eab tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:35.737599 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7a9495a1-3b71-4df6-81be-f1c45c3f0eab tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:35.738063 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7a9495a1-3b71-4df6-81be-f1c45c3f0eab tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:35.738595 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7a9495a1-3b71-4df6-81be-f1c45c3f0eab tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:35.880163 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-7a9495a1-3b71-4df6-81be-f1c45c3f0eab tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:35.889336 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-7a9495a1-3b71-4df6-81be-f1c45c3f0eab tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1555 microversion: 2.1 time: 0.169981 Aug 29 21:51:35.890205 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 74/149] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:35 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:36.071955 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-9d1be0d5-1d1c-40f1-b4e3-98a0e344cac0 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:36.072816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-9d1be0d5-1d1c-40f1-b4e3-98a0e344cac0 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:36.083505 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9d1be0d5-1d1c-40f1-b4e3-98a0e344cac0 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:36.084007 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9d1be0d5-1d1c-40f1-b4e3-98a0e344cac0 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:36.086064 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9d1be0d5-1d1c-40f1-b4e3-98a0e344cac0 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:36.086064 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9d1be0d5-1d1c-40f1-b4e3-98a0e344cac0 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:36.086064 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9d1be0d5-1d1c-40f1-b4e3-98a0e344cac0 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:36.086064 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9d1be0d5-1d1c-40f1-b4e3-98a0e344cac0 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:36.251622 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9d1be0d5-1d1c-40f1-b4e3-98a0e344cac0 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:36.260387 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-9d1be0d5-1d1c-40f1-b4e3-98a0e344cac0 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1314 microversion: 2.1 time: 0.192276 Aug 29 21:51:36.261029 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 76/150] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:36 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:36.911125 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-1556b1a9-ceca-421a-98a0-785bc4edd900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:36.911690 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-1556b1a9-ceca-421a-98a0-785bc4edd900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:36.918238 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1556b1a9-ceca-421a-98a0-785bc4edd900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:36.918731 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1556b1a9-ceca-421a-98a0-785bc4edd900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:36.919718 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1556b1a9-ceca-421a-98a0-785bc4edd900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:36.920781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1556b1a9-ceca-421a-98a0-785bc4edd900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:36.921244 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1556b1a9-ceca-421a-98a0-785bc4edd900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:36.922307 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1556b1a9-ceca-421a-98a0-785bc4edd900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:37.154894 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1556b1a9-ceca-421a-98a0-785bc4edd900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:37.163675 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-1556b1a9-ceca-421a-98a0-785bc4edd900 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1555 microversion: 2.1 time: 0.256508 Aug 29 21:51:37.164260 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 75/151] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:36 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1555 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:37.284274 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0595913b-8892-46a8-8681-0312e35771bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:37.284926 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0595913b-8892-46a8-8681-0312e35771bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:37.291710 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0595913b-8892-46a8-8681-0312e35771bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:37.292318 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0595913b-8892-46a8-8681-0312e35771bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:37.292967 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0595913b-8892-46a8-8681-0312e35771bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:37.293692 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0595913b-8892-46a8-8681-0312e35771bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:37.294687 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0595913b-8892-46a8-8681-0312e35771bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:37.295373 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0595913b-8892-46a8-8681-0312e35771bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:37.453288 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0595913b-8892-46a8-8681-0312e35771bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:37.462215 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0595913b-8892-46a8-8681-0312e35771bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1314 microversion: 2.1 time: 0.182498 Aug 29 21:51:37.462944 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 77/152] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:37 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:38.190064 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9ada8400-da7d-4364-a7e1-335095fd9f1c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:38.192426 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9ada8400-da7d-4364-a7e1-335095fd9f1c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:38.208346 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9ada8400-da7d-4364-a7e1-335095fd9f1c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:38.210290 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9ada8400-da7d-4364-a7e1-335095fd9f1c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:38.211583 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9ada8400-da7d-4364-a7e1-335095fd9f1c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:38.213209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9ada8400-da7d-4364-a7e1-335095fd9f1c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:38.214306 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9ada8400-da7d-4364-a7e1-335095fd9f1c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:38.215091 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9ada8400-da7d-4364-a7e1-335095fd9f1c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:38.416716 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9ada8400-da7d-4364-a7e1-335095fd9f1c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:38.429552 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9ada8400-da7d-4364-a7e1-335095fd9f1c tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1555 microversion: 2.1 time: 0.247243 Aug 29 21:51:38.430138 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 76/153] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:38 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1555 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:38.484726 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d0897e13-2772-44e8-b8db-4b54bea08873 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:38.485603 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d0897e13-2772-44e8-b8db-4b54bea08873 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:38.492390 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0897e13-2772-44e8-b8db-4b54bea08873 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:38.492932 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0897e13-2772-44e8-b8db-4b54bea08873 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:38.493431 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0897e13-2772-44e8-b8db-4b54bea08873 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:38.494151 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0897e13-2772-44e8-b8db-4b54bea08873 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:38.494611 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0897e13-2772-44e8-b8db-4b54bea08873 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:38.495046 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0897e13-2772-44e8-b8db-4b54bea08873 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:38.660907 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d0897e13-2772-44e8-b8db-4b54bea08873 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:38.669314 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d0897e13-2772-44e8-b8db-4b54bea08873 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1314 microversion: 2.1 time: 0.189021 Aug 29 21:51:38.683333 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 78/154] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:38 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:39.460327 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-049c6395-c2b5-479d-bb94-8f0f64d5f73a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:39.461507 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-049c6395-c2b5-479d-bb94-8f0f64d5f73a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:39.465109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:39.472045 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-049c6395-c2b5-479d-bb94-8f0f64d5f73a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:39.472928 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-049c6395-c2b5-479d-bb94-8f0f64d5f73a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:39.473643 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-049c6395-c2b5-479d-bb94-8f0f64d5f73a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:39.474603 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-049c6395-c2b5-479d-bb94-8f0f64d5f73a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:39.475344 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-049c6395-c2b5-479d-bb94-8f0f64d5f73a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:39.476059 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-049c6395-c2b5-479d-bb94-8f0f64d5f73a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:39.698695 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0cdf3da0-9941-4f6b-aab3-b1d2f8d6e1bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:39.698695 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0cdf3da0-9941-4f6b-aab3-b1d2f8d6e1bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:39.707713 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0cdf3da0-9941-4f6b-aab3-b1d2f8d6e1bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:39.708338 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0cdf3da0-9941-4f6b-aab3-b1d2f8d6e1bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:39.714197 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0cdf3da0-9941-4f6b-aab3-b1d2f8d6e1bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:39.715179 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0cdf3da0-9941-4f6b-aab3-b1d2f8d6e1bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:39.715705 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0cdf3da0-9941-4f6b-aab3-b1d2f8d6e1bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:39.716186 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0cdf3da0-9941-4f6b-aab3-b1d2f8d6e1bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:39.815985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-049c6395-c2b5-479d-bb94-8f0f64d5f73a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:39.828782 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-049c6395-c2b5-479d-bb94-8f0f64d5f73a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1555 microversion: 2.1 time: 0.372889 Aug 29 21:51:39.828782 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 77/155] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:39 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1555 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:39.831964 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-c37ebb9a-4247-4004-929d-717997f8fb0b req-c27a73f4-c6a1-4d97-b187-efdc6c28d2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6226c525-5ef4-4f3e-b09d-b4c38b6bd367", "name": "network-vif-deleted", "tag": "671a0014-dd0d-4ecc-9b85-607c479d6da5"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:51:39.842276 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-c37ebb9a-4247-4004-929d-717997f8fb0b req-c27a73f4-c6a1-4d97-b187-efdc6c28d2a7 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:39.843033 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-c37ebb9a-4247-4004-929d-717997f8fb0b req-c27a73f4-c6a1-4d97-b187-efdc6c28d2a7 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:39.843625 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-c37ebb9a-4247-4004-929d-717997f8fb0b req-c27a73f4-c6a1-4d97-b187-efdc6c28d2a7 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:39.868681 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-c37ebb9a-4247-4004-929d-717997f8fb0b req-c27a73f4-c6a1-4d97-b187-efdc6c28d2a7 service nova] Creating event network-vif-deleted:671a0014-dd0d-4ecc-9b85-607c479d6da5 for instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 on hv-cinder-85426 Aug 29 21:51:39.875905 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-c37ebb9a-4247-4004-929d-717997f8fb0b req-c27a73f4-c6a1-4d97-b187-efdc6c28d2a7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047526 Aug 29 21:51:39.877179 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 78/156] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:51:39.990564 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0cdf3da0-9941-4f6b-aab3-b1d2f8d6e1bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:40.004828 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0cdf3da0-9941-4f6b-aab3-b1d2f8d6e1bb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1498 microversion: 2.1 time: 0.312597 Aug 29 21:51:40.021346 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 79/157] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:39 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1498 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:40.881285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-241d437d-1b83-484c-810e-5dd708d74e82 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:40.882544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-241d437d-1b83-484c-810e-5dd708d74e82 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:40.901828 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-241d437d-1b83-484c-810e-5dd708d74e82 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:40.903709 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-241d437d-1b83-484c-810e-5dd708d74e82 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:40.906764 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-241d437d-1b83-484c-810e-5dd708d74e82 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:40.909118 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-241d437d-1b83-484c-810e-5dd708d74e82 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:40.910206 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-241d437d-1b83-484c-810e-5dd708d74e82 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:40.910984 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-241d437d-1b83-484c-810e-5dd708d74e82 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:41.006303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-241d437d-1b83-484c-810e-5dd708d74e82 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:41.018296 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-241d437d-1b83-484c-810e-5dd708d74e82 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1346 microversion: 2.1 time: 0.156872 Aug 29 21:51:41.019233 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 79/158] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:40 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1346 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:42.046627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f2179e29-72c2-4f02-9526-758ef815a773 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:42.048631 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f2179e29-72c2-4f02-9526-758ef815a773 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:42.052578 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:42.061022 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f2179e29-72c2-4f02-9526-758ef815a773 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:42.063738 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f2179e29-72c2-4f02-9526-758ef815a773 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:42.063738 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f2179e29-72c2-4f02-9526-758ef815a773 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:42.064310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f2179e29-72c2-4f02-9526-758ef815a773 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:42.065216 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f2179e29-72c2-4f02-9526-758ef815a773 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:42.066036 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f2179e29-72c2-4f02-9526-758ef815a773 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:42.143198 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f2179e29-72c2-4f02-9526-758ef815a773 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:42.143198 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f2179e29-72c2-4f02-9526-758ef815a773 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:42.143198 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f2179e29-72c2-4f02-9526-758ef815a773 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:42.143198 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-f2179e29-72c2-4f02-9526-758ef815a773 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lazy-loading 'fault' on Instance uuid 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:51:42.228821 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f2179e29-72c2-4f02-9526-758ef815a773 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2698bc78f2e3432faf8fd2a1d16d3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:42.245005 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f2179e29-72c2-4f02-9526-758ef815a773 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 200 len: 1351 microversion: 2.1 time: 0.202569 Aug 29 21:51:42.252732 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 80/159] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:42 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 1351 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:51:43.263989 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ddef41ac-fd4d-4de7-9b40-07edba04d50a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:43.264636 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ddef41ac-fd4d-4de7-9b40-07edba04d50a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:43.271209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ddef41ac-fd4d-4de7-9b40-07edba04d50a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:43.271733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ddef41ac-fd4d-4de7-9b40-07edba04d50a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:43.272219 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ddef41ac-fd4d-4de7-9b40-07edba04d50a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:43.272996 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ddef41ac-fd4d-4de7-9b40-07edba04d50a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:43.273482 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ddef41ac-fd4d-4de7-9b40-07edba04d50a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:43.273932 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ddef41ac-fd4d-4de7-9b40-07edba04d50a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:43.288967 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-ddef41ac-fd4d-4de7-9b40-07edba04d50a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] HTTP exception thrown: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ddef41ac-fd4d-4de7-9b40-07edba04d50a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Request method failure captured: Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 HTTP/1.1 Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTSwQImzLUSA5SEGibFcq87TgG-5lP8ZMMhSf1XJKokzAtm-iadnoOYKB-b2uDR8xYkAwJTb-mR1zecQDMp2fToa1j16esnfAYh5hBs3RxyruQopxukyWw7nu04NnjK0MebzTeqEq_Z-XYhnMx9yz7kWBl4foEw-upmsXj8f3W7F_dI Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: be7f29d3c82242b7bdc4ead9fa6f4afc Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-DeleteServersTestJSON-160404580 Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:51:43.294334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:51:43.296130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:51:43.296130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-DeleteServersTestJSON-160404580 Aug 29 21:51:43.296130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: be7f29d3c82242b7bdc4ead9fa6f4afc Aug 29 21:51:43.296130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-DeleteServersTestJSON-160404580 Aug 29 21:51:43.296130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-DeleteServersTestJSON-160404580-project Aug 29 21:51:43.296130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:51:43.296130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:51:43.296130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 2698bc78f2e3432faf8fd2a1d16d3b3a Aug 29 21:51:43.296130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-DeleteServersTestJSON-160404580-project Aug 29 21:51:43.296130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:51:43.296130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:43.296130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '6226c525-5ef4-4f3e-b09d-b4c38b6bd367'} Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:51:43.297055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:43.298634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:51:43.301376 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ddef41ac-fd4d-4de7-9b40-07edba04d50a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Returning 404 to user: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:51:43.301376 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ddef41ac-fd4d-4de7-9b40-07edba04d50a tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 404 len: 111 microversion: 2.1 time: 0.036693 Aug 29 21:51:43.301376 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 80/160] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:43 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:51:43.462616 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-5cca8c21-5085-4dbd-b584-ebaa757eb971 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:43.466271 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-5cca8c21-5085-4dbd-b584-ebaa757eb971 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:43.476130 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5cca8c21-5085-4dbd-b584-ebaa757eb971 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:43.476910 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5cca8c21-5085-4dbd-b584-ebaa757eb971 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:43.477505 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5cca8c21-5085-4dbd-b584-ebaa757eb971 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:43.478201 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5cca8c21-5085-4dbd-b584-ebaa757eb971 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:43.478967 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5cca8c21-5085-4dbd-b584-ebaa757eb971 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:43.479615 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5cca8c21-5085-4dbd-b584-ebaa757eb971 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:43.501683 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-5cca8c21-5085-4dbd-b584-ebaa757eb971 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] HTTP exception thrown: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-5cca8c21-5085-4dbd-b584-ebaa757eb971 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Request method failure captured: Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367/os-volume_attachments HTTP/1.1 Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTSwQImzLUSA5SEGibFcq87TgG-5lP8ZMMhSf1XJKokzAtm-iadnoOYKB-b2uDR8xYkAwJTb-mR1zecQDMp2fToa1j16esnfAYh5hBs3RxyruQopxukyWw7nu04NnjK0MebzTeqEq_Z-XYhnMx9yz7kWBl4foEw-upmsXj8f3W7F_dI Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: be7f29d3c82242b7bdc4ead9fa6f4afc Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-DeleteServersTestJSON-160404580 Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 21:51:43.512157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 21:51:43.515725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:51:43.515725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-DeleteServersTestJSON-160404580 Aug 29 21:51:43.515725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: be7f29d3c82242b7bdc4ead9fa6f4afc Aug 29 21:51:43.515725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-DeleteServersTestJSON-160404580 Aug 29 21:51:43.515725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-DeleteServersTestJSON-160404580-project Aug 29 21:51:43.515725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 21:51:43.515725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 21:51:43.515725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 2698bc78f2e3432faf8fd2a1d16d3b3a Aug 29 21:51:43.515725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-DeleteServersTestJSON-160404580-project Aug 29 21:51:43.515725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 21:51:43.515725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:43.515725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'server_id': '6226c525-5ef4-4f3e-b09d-b4c38b6bd367'} Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:51:43.516980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:43.519256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:51:43.531480 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-5cca8c21-5085-4dbd-b584-ebaa757eb971 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Returning 404 to user: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:51:43.531480 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-5cca8c21-5085-4dbd-b584-ebaa757eb971 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.060534 Aug 29 21:51:43.531480 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 81/161] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 21:51:43 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367/os-volume_attachments => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:51:45.048254 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a92a5a2b-f4a5-4b71-8496-d4499c5a118f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:45.048867 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a92a5a2b-f4a5-4b71-8496-d4499c5a118f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:45.055495 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a92a5a2b-f4a5-4b71-8496-d4499c5a118f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:45.056264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a92a5a2b-f4a5-4b71-8496-d4499c5a118f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:45.056724 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a92a5a2b-f4a5-4b71-8496-d4499c5a118f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:45.057589 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a92a5a2b-f4a5-4b71-8496-d4499c5a118f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:45.058256 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a92a5a2b-f4a5-4b71-8496-d4499c5a118f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:45.059095 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a92a5a2b-f4a5-4b71-8496-d4499c5a118f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:45.088011 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-a92a5a2b-f4a5-4b71-8496-d4499c5a118f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] HTTP exception thrown: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a92a5a2b-f4a5-4b71-8496-d4499c5a118f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Request method failure captured: Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: DELETE /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 HTTP/1.1 Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTSwQImzLUSA5SEGibFcq87TgG-5lP8ZMMhSf1XJKokzAtm-iadnoOYKB-b2uDR8xYkAwJTb-mR1zecQDMp2fToa1j16esnfAYh5hBs3RxyruQopxukyWw7nu04NnjK0MebzTeqEq_Z-XYhnMx9yz7kWBl4foEw-upmsXj8f3W7F_dI Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: be7f29d3c82242b7bdc4ead9fa6f4afc Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-DeleteServersTestJSON-160404580 Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:51:45.089701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:51:45.091808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:51:45.091808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-DeleteServersTestJSON-160404580 Aug 29 21:51:45.091808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: be7f29d3c82242b7bdc4ead9fa6f4afc Aug 29 21:51:45.091808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-DeleteServersTestJSON-160404580 Aug 29 21:51:45.091808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-DeleteServersTestJSON-160404580-project Aug 29 21:51:45.091808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:51:45.091808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:51:45.091808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 2698bc78f2e3432faf8fd2a1d16d3b3a Aug 29 21:51:45.091808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-DeleteServersTestJSON-160404580-project Aug 29 21:51:45.091808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:51:45.091808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:45.091808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '6226c525-5ef4-4f3e-b09d-b4c38b6bd367'} Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:51:45.092763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:45.094070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:51:45.095388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a92a5a2b-f4a5-4b71-8496-d4499c5a118f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Returning 404 to user: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:51:45.095770 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a92a5a2b-f4a5-4b71-8496-d4499c5a118f tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "DELETE /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 404 len: 111 microversion: 2.1 time: 0.051709 Aug 29 21:51:45.099934 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 81/162] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:51:45 2022] DELETE /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:51:45.105163 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ff8d1c3e-3398-4ece-b32f-c17bbe24dca2 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:45.110166 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ff8d1c3e-3398-4ece-b32f-c17bbe24dca2 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] [instance: 6226c525-5ef4-4f3e-b09d-b4c38b6bd367] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:45.113311 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ff8d1c3e-3398-4ece-b32f-c17bbe24dca2 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:45.114013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ff8d1c3e-3398-4ece-b32f-c17bbe24dca2 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:45.114598 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ff8d1c3e-3398-4ece-b32f-c17bbe24dca2 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:45.115569 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ff8d1c3e-3398-4ece-b32f-c17bbe24dca2 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:45.116195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ff8d1c3e-3398-4ece-b32f-c17bbe24dca2 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:45.116971 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ff8d1c3e-3398-4ece-b32f-c17bbe24dca2 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:45.148627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-ff8d1c3e-3398-4ece-b32f-c17bbe24dca2 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] HTTP exception thrown: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ff8d1c3e-3398-4ece-b32f-c17bbe24dca2 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Request method failure captured: Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 HTTP/1.1 Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTSwQImzLUSA5SEGibFcq87TgG-5lP8ZMMhSf1XJKokzAtm-iadnoOYKB-b2uDR8xYkAwJTb-mR1zecQDMp2fToa1j16esnfAYh5hBs3RxyruQopxukyWw7nu04NnjK0MebzTeqEq_Z-XYhnMx9yz7kWBl4foEw-upmsXj8f3W7F_dI Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: be7f29d3c82242b7bdc4ead9fa6f4afc Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-DeleteServersTestJSON-160404580 Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 21:51:45.173412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 21:51:45.175617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/be7f29d3c82242b7bdc4ead9fa6f4afc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:51:45.175617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-DeleteServersTestJSON-160404580 Aug 29 21:51:45.175617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: be7f29d3c82242b7bdc4ead9fa6f4afc Aug 29 21:51:45.175617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-DeleteServersTestJSON-160404580 Aug 29 21:51:45.175617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-DeleteServersTestJSON-160404580-project Aug 29 21:51:45.175617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 21:51:45.175617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 21:51:45.175617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 2698bc78f2e3432faf8fd2a1d16d3b3a Aug 29 21:51:45.175617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-DeleteServersTestJSON-160404580-project Aug 29 21:51:45.175617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 21:51:45.175617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:45.175617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': '6226c525-5ef4-4f3e-b09d-b4c38b6bd367'} Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:51:45.176816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. Aug 29 21:51:45.178677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:51:45.179920 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ff8d1c3e-3398-4ece-b32f-c17bbe24dca2 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] Returning 404 to user: Instance 6226c525-5ef4-4f3e-b09d-b4c38b6bd367 could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:51:45.179920 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ff8d1c3e-3398-4ece-b32f-c17bbe24dca2 tempest-DeleteServersTestJSON-160404580 tempest-DeleteServersTestJSON-160404580-project] 10.222.0.83 "GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367" status: 404 len: 111 microversion: 2.1 time: 0.077075 Aug 29 21:51:45.180652 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 82/163] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:45 2022] GET /compute/v2.1/servers/6226c525-5ef4-4f3e-b09d-b4c38b6bd367 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:51:46.241528 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6132e06c-eeaa-4abc-8fe0-8271dba74639 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:46.242065 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-6132e06c-eeaa-4abc-8fe0-8271dba74639 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:46.250071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6132e06c-eeaa-4abc-8fe0-8271dba74639 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:46.250580 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6132e06c-eeaa-4abc-8fe0-8271dba74639 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:46.251036 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6132e06c-eeaa-4abc-8fe0-8271dba74639 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:46.251759 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6132e06c-eeaa-4abc-8fe0-8271dba74639 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:46.252202 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6132e06c-eeaa-4abc-8fe0-8271dba74639 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:46.252834 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6132e06c-eeaa-4abc-8fe0-8271dba74639 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:46.283990 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-6132e06c-eeaa-4abc-8fe0-8271dba74639 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Going to try to terminate instance {{(pid=127882) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:51:46.885114 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-6132e06c-eeaa-4abc-8fe0-8271dba74639 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "DELETE /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 204 len: 0 microversion: 2.1 time: 0.646849 Aug 29 21:51:46.886342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 82/164] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:51:46 2022] DELETE /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:51:46.896859 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-3c88729a-a84b-4069-92fc-71f0b71be3eb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:46.897697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-3c88729a-a84b-4069-92fc-71f0b71be3eb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:46.905517 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3c88729a-a84b-4069-92fc-71f0b71be3eb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:46.907770 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3c88729a-a84b-4069-92fc-71f0b71be3eb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:46.908312 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3c88729a-a84b-4069-92fc-71f0b71be3eb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:46.909162 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3c88729a-a84b-4069-92fc-71f0b71be3eb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:46.909718 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3c88729a-a84b-4069-92fc-71f0b71be3eb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:46.910331 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3c88729a-a84b-4069-92fc-71f0b71be3eb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:47.202300 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-3c88729a-a84b-4069-92fc-71f0b71be3eb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:47.212141 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-3c88729a-a84b-4069-92fc-71f0b71be3eb tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1504 microversion: 2.1 time: 0.319079 Aug 29 21:51:47.213432 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 83/165] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:46 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1504 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:48.255011 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-feb2943b-75db-4ced-82b5-454f56f1e919 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:48.255011 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-feb2943b-75db-4ced-82b5-454f56f1e919 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:48.263731 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-feb2943b-75db-4ced-82b5-454f56f1e919 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:48.264802 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-feb2943b-75db-4ced-82b5-454f56f1e919 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:48.268031 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-feb2943b-75db-4ced-82b5-454f56f1e919 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:48.268031 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-feb2943b-75db-4ced-82b5-454f56f1e919 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:48.268031 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-feb2943b-75db-4ced-82b5-454f56f1e919 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:48.268031 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-feb2943b-75db-4ced-82b5-454f56f1e919 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:48.331328 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:48.460669 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-feb2943b-75db-4ced-82b5-454f56f1e919 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:48.482019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-feb2943b-75db-4ced-82b5-454f56f1e919 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1504 microversion: 2.1 time: 0.245924 Aug 29 21:51:48.483636 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 83/166] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:48 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:49.509419 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-58712843-d8c4-45a1-90b9-40c7d31df945 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:49.513481 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-58712843-d8c4-45a1-90b9-40c7d31df945 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:49.529709 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58712843-d8c4-45a1-90b9-40c7d31df945 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:49.530235 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58712843-d8c4-45a1-90b9-40c7d31df945 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:49.530684 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58712843-d8c4-45a1-90b9-40c7d31df945 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:49.531407 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58712843-d8c4-45a1-90b9-40c7d31df945 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:49.531858 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58712843-d8c4-45a1-90b9-40c7d31df945 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:49.532296 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58712843-d8c4-45a1-90b9-40c7d31df945 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:49.810621 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-58712843-d8c4-45a1-90b9-40c7d31df945 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:49.821180 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-58712843-d8c4-45a1-90b9-40c7d31df945 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1504 microversion: 2.1 time: 0.321062 Aug 29 21:51:49.831405 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 84/167] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:49 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:49.845707 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-6ff9119f-9ffe-4fc6-bd08-7cc52e0feabe req-eefb66e6-caa0-4890-8255-28481fc80c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5164e3ed-1070-403d-8a4c-fc44b15b4a17", "name": "network-vif-deleted", "tag": "b888e935-f438-4e47-b7be-475f31967df3"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:51:49.869542 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-6ff9119f-9ffe-4fc6-bd08-7cc52e0feabe req-eefb66e6-caa0-4890-8255-28481fc80c8e service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:49.870628 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-6ff9119f-9ffe-4fc6-bd08-7cc52e0feabe req-eefb66e6-caa0-4890-8255-28481fc80c8e service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:49.871355 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-6ff9119f-9ffe-4fc6-bd08-7cc52e0feabe req-eefb66e6-caa0-4890-8255-28481fc80c8e service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:49.887609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-6ff9119f-9ffe-4fc6-bd08-7cc52e0feabe req-eefb66e6-caa0-4890-8255-28481fc80c8e service nova] Creating event network-vif-deleted:b888e935-f438-4e47-b7be-475f31967df3 for instance 5164e3ed-1070-403d-8a4c-fc44b15b4a17 on hv-cinder-85426 Aug 29 21:51:49.893099 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-6ff9119f-9ffe-4fc6-bd08-7cc52e0feabe req-eefb66e6-caa0-4890-8255-28481fc80c8e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051416 Aug 29 21:51:49.900471 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 84/168] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:51:50.844449 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-41a760ef-4b40-4466-82ba-c142f7a6eb35 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:50.845136 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-41a760ef-4b40-4466-82ba-c142f7a6eb35 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:50.854370 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41a760ef-4b40-4466-82ba-c142f7a6eb35 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:50.854762 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41a760ef-4b40-4466-82ba-c142f7a6eb35 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:50.855212 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41a760ef-4b40-4466-82ba-c142f7a6eb35 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:50.855962 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41a760ef-4b40-4466-82ba-c142f7a6eb35 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:50.856612 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41a760ef-4b40-4466-82ba-c142f7a6eb35 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:50.857031 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41a760ef-4b40-4466-82ba-c142f7a6eb35 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:50.894936 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41a760ef-4b40-4466-82ba-c142f7a6eb35 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:50.895669 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41a760ef-4b40-4466-82ba-c142f7a6eb35 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:50.896180 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41a760ef-4b40-4466-82ba-c142f7a6eb35 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:50.896820 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-41a760ef-4b40-4466-82ba-c142f7a6eb35 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lazy-loading 'fault' on Instance uuid 5164e3ed-1070-403d-8a4c-fc44b15b4a17 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:51:50.940176 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-41a760ef-4b40-4466-82ba-c142f7a6eb35 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad1787af22c94bc8a3599abf7e8fbe39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91575ac1354247dca14aff7bbfe5d111', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:51:50.948294 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-41a760ef-4b40-4466-82ba-c142f7a6eb35 tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 200 len: 1304 microversion: 2.1 time: 0.107805 Aug 29 21:51:50.948929 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 85/169] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:50 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:51:51.978685 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c1b566ac-fe63-4562-afbc-3556150e787d tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:51:51.979633 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c1b566ac-fe63-4562-afbc-3556150e787d tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] [instance: 5164e3ed-1070-403d-8a4c-fc44b15b4a17] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:51:51.989305 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c1b566ac-fe63-4562-afbc-3556150e787d tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:51.989809 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c1b566ac-fe63-4562-afbc-3556150e787d tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:51.990250 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c1b566ac-fe63-4562-afbc-3556150e787d tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:51.990987 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c1b566ac-fe63-4562-afbc-3556150e787d tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:51:51.991455 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c1b566ac-fe63-4562-afbc-3556150e787d tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:51:51.991884 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c1b566ac-fe63-4562-afbc-3556150e787d tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:51:52.009212 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-c1b566ac-fe63-4562-afbc-3556150e787d tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] HTTP exception thrown: Instance 5164e3ed-1070-403d-8a4c-fc44b15b4a17 could not be found. Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c1b566ac-fe63-4562-afbc-3556150e787d tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Request method failure captured: Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 HTTP/1.1 Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTTLse0raFfBfUaGhmB9R14LflJn8w8a8ezGz_agtVtIC05-jFSoNGAjJ6relYtupK7kuWTM8Xal2PGu_F1dAxfuzwgp6-HpFv4QG-vwgZhfQ-dAAapU75-PCKZgfuwsCs5lyvbLOwjIxJpyEO4MXtppc3BXDyRln9xsuXqILQGTIT0 Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 91575ac1354247dca14aff7bbfe5d111 Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-VolumesActionsTest-1461678361 Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:51:52.011973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:51:52.013261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/91575ac1354247dca14aff7bbfe5d111"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_91575ac1354247dca14aff7bbfe5d111"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/91575ac1354247dca14aff7bbfe5d111"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/91575ac1354247dca14aff7bbfe5d111"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:51:52.013261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-VolumesActionsTest-1461678361 Aug 29 21:51:52.013261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 91575ac1354247dca14aff7bbfe5d111 Aug 29 21:51:52.013261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-VolumesActionsTest-1461678361 Aug 29 21:51:52.013261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-VolumesActionsTest-1461678361-project Aug 29 21:51:52.013261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:51:52.013261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:51:52.013261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: ad1787af22c94bc8a3599abf7e8fbe39 Aug 29 21:51:52.013261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-VolumesActionsTest-1461678361-project Aug 29 21:51:52.013261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:51:52.013261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 5164e3ed-1070-403d-8a4c-fc44b15b4a17 could not be found. Aug 29 21:51:52.013261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '5164e3ed-1070-403d-8a4c-fc44b15b4a17'} Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5164e3ed-1070-403d-8a4c-fc44b15b4a17 could not be found. Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:51:52.014224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5164e3ed-1070-403d-8a4c-fc44b15b4a17 could not be found. Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5164e3ed-1070-403d-8a4c-fc44b15b4a17 could not be found. Aug 29 21:51:52.015620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:51:52.018128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c1b566ac-fe63-4562-afbc-3556150e787d tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] Returning 404 to user: Instance 5164e3ed-1070-403d-8a4c-fc44b15b4a17 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:51:52.019253 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c1b566ac-fe63-4562-afbc-3556150e787d tempest-VolumesActionsTest-1461678361 tempest-VolumesActionsTest-1461678361-project] 10.222.0.83 "GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17" status: 404 len: 111 microversion: 2.1 time: 0.046024 Aug 29 21:51:52.023434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 85/170] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:51:51 2022] GET /compute/v2.1/servers/5164e3ed-1070-403d-8a4c-fc44b15b4a17 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:52:01.684426 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=15 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:01.685204 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:01.834051 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1265241140", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:52:01.887068 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.network.neutron [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] validate_networks() for [('14f51079-9a2d-46d9-81f3-23979d57f79f', None, None, None, None, None)] {{(pid=127883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:52:02.328533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Flavor limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:52:02.328933 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Image limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:52:02.329410 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Flavor pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:52:02.329849 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Image pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:52:02.330444 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:52:02.340229 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:02.340755 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:02.344584 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:02.344584 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:02.344584 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:02.344584 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:02.363634 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Getting quotas for project f8ca070dc59e4a69bdaca0150f92bcc4. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:52:02.368094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Getting quotas for user 3575098818954a949e202397a1b20a6a and project f8ca070dc59e4a69bdaca0150f92bcc4. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:52:02.391466 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Going to run 1 instances... {{(pid=127883) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:52:02.394123 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:52:02.658959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d5234ba3-75cb-4840-b6e1-b76ffa448889 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.979290 Aug 29 21:52:02.664632 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 86/171] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:52:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:52:02.672618 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0a44c933-6974-4903-afc9-07a661f3fe84 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:02.673371 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-0a44c933-6974-4903-afc9-07a661f3fe84 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:02.679916 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:02.738998 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-0a44c933-6974-4903-afc9-07a661f3fe84 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:02.749054 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-0a44c933-6974-4903-afc9-07a661f3fe84 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1222 microversion: 2.1 time: 0.080016 Aug 29 21:52:02.768693 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 86/172] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:02 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:02.840443 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1242824288", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:52:02.950204 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.network.neutron [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] validate_networks() for [('14f51079-9a2d-46d9-81f3-23979d57f79f', None, None, None, None, None)] {{(pid=127883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:52:03.358260 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Flavor limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:52:03.358893 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Image limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:52:03.359371 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Flavor pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:52:03.359784 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Image pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:52:03.360207 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:52:03.369668 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:03.374715 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:03.374715 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:03.374715 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:03.374715 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:03.375113 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:03.404893 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Getting quotas for project f8ca070dc59e4a69bdaca0150f92bcc4. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:52:03.414668 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Getting quotas for user 3575098818954a949e202397a1b20a6a and project f8ca070dc59e4a69bdaca0150f92bcc4. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:52:03.430373 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Going to run 1 instances... {{(pid=127883) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:52:03.432784 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:52:03.604050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-c2b2aa54-b077-4ec5-8f02-718ec8518ff9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.772121 Aug 29 21:52:03.604957 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 87/173] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:52:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:52:03.616151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d7a205a4-bd7c-434e-8db9-99f5aeb21a54 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:03.616812 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d7a205a4-bd7c-434e-8db9-99f5aeb21a54 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:03.673582 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d7a205a4-bd7c-434e-8db9-99f5aeb21a54 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:03.688474 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d7a205a4-bd7c-434e-8db9-99f5aeb21a54 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1222 microversion: 2.1 time: 0.076374 Aug 29 21:52:03.689475 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 87/174] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:03 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1222 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:04.710937 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-29e2fa13-56d7-4c16-a66d-f32ec999455c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:04.711557 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-29e2fa13-56d7-4c16-a66d-f32ec999455c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:04.803421 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-29e2fa13-56d7-4c16-a66d-f32ec999455c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:04.811414 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-29e2fa13-56d7-4c16-a66d-f32ec999455c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1222 microversion: 2.1 time: 0.104682 Aug 29 21:52:04.817594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 88/175] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:04 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1222 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:05.835149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c93fbb65-1981-4e2b-97a8-ee45ae2d853a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:05.836348 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c93fbb65-1981-4e2b-97a8-ee45ae2d853a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:05.844724 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c93fbb65-1981-4e2b-97a8-ee45ae2d853a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:05.845206 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c93fbb65-1981-4e2b-97a8-ee45ae2d853a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:05.845844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c93fbb65-1981-4e2b-97a8-ee45ae2d853a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:05.846704 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c93fbb65-1981-4e2b-97a8-ee45ae2d853a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:05.847302 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c93fbb65-1981-4e2b-97a8-ee45ae2d853a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:05.847873 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c93fbb65-1981-4e2b-97a8-ee45ae2d853a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:05.929748 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c93fbb65-1981-4e2b-97a8-ee45ae2d853a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:05.940948 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c93fbb65-1981-4e2b-97a8-ee45ae2d853a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1218 microversion: 2.1 time: 0.110501 Aug 29 21:52:05.941805 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 88/176] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:05 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:52:06.963672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f2240a82-c6f3-4ac3-bb93-02ccebf960db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:06.964594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f2240a82-c6f3-4ac3-bb93-02ccebf960db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:06.971570 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f2240a82-c6f3-4ac3-bb93-02ccebf960db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:06.972126 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f2240a82-c6f3-4ac3-bb93-02ccebf960db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:06.972600 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f2240a82-c6f3-4ac3-bb93-02ccebf960db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:06.979228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f2240a82-c6f3-4ac3-bb93-02ccebf960db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:06.979755 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f2240a82-c6f3-4ac3-bb93-02ccebf960db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:06.980208 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f2240a82-c6f3-4ac3-bb93-02ccebf960db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:07.069517 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f2240a82-c6f3-4ac3-bb93-02ccebf960db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:07.077571 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f2240a82-c6f3-4ac3-bb93-02ccebf960db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1274 microversion: 2.1 time: 0.118782 Aug 29 21:52:07.078154 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 89/177] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:06 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1274 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:08.107236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f7de1697-8d4c-4c99-b2a5-091425c88457 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:08.120250 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f7de1697-8d4c-4c99-b2a5-091425c88457 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:08.129521 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f7de1697-8d4c-4c99-b2a5-091425c88457 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:08.130463 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f7de1697-8d4c-4c99-b2a5-091425c88457 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:08.131498 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f7de1697-8d4c-4c99-b2a5-091425c88457 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:08.132256 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f7de1697-8d4c-4c99-b2a5-091425c88457 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:08.134931 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f7de1697-8d4c-4c99-b2a5-091425c88457 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:08.135500 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f7de1697-8d4c-4c99-b2a5-091425c88457 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:08.246219 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f7de1697-8d4c-4c99-b2a5-091425c88457 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:08.262235 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f7de1697-8d4c-4c99-b2a5-091425c88457 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1280 microversion: 2.1 time: 0.165656 Aug 29 21:52:08.276804 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 89/178] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:08 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1280 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:09.282991 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e2a73342-2e1d-4e97-b721-3d1bf53c0e69 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:09.283601 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e2a73342-2e1d-4e97-b721-3d1bf53c0e69 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:09.290475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e2a73342-2e1d-4e97-b721-3d1bf53c0e69 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:09.290960 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e2a73342-2e1d-4e97-b721-3d1bf53c0e69 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:09.291389 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e2a73342-2e1d-4e97-b721-3d1bf53c0e69 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:09.292388 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e2a73342-2e1d-4e97-b721-3d1bf53c0e69 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:09.292550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e2a73342-2e1d-4e97-b721-3d1bf53c0e69 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:09.293572 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e2a73342-2e1d-4e97-b721-3d1bf53c0e69 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:09.428433 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e2a73342-2e1d-4e97-b721-3d1bf53c0e69 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:09.436128 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e2a73342-2e1d-4e97-b721-3d1bf53c0e69 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1322 microversion: 2.1 time: 0.156979 Aug 29 21:52:09.436718 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 90/179] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:09 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:10.248677 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-23ce2e25-12dd-4e9d-81ad-04ff585e2d85 req-feff2592-fc6a-4fad-bfca-7c71a147e91d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a4fc48-d58f-4227-a8aa-5d4d227c33d8", "tag": "15cd5989-a04d-4d6e-9c81-fdd78d421299"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:52:10.258789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-23ce2e25-12dd-4e9d-81ad-04ff585e2d85 req-feff2592-fc6a-4fad-bfca-7c71a147e91d service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:10.259368 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-23ce2e25-12dd-4e9d-81ad-04ff585e2d85 req-feff2592-fc6a-4fad-bfca-7c71a147e91d service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:10.259807 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-23ce2e25-12dd-4e9d-81ad-04ff585e2d85 req-feff2592-fc6a-4fad-bfca-7c71a147e91d service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:10.271761 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-23ce2e25-12dd-4e9d-81ad-04ff585e2d85 req-feff2592-fc6a-4fad-bfca-7c71a147e91d service nova] Creating event network-changed:15cd5989-a04d-4d6e-9c81-fdd78d421299 for instance 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 on hv-cinder-85426 Aug 29 21:52:10.279019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-23ce2e25-12dd-4e9d-81ad-04ff585e2d85 req-feff2592-fc6a-4fad-bfca-7c71a147e91d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034411 Aug 29 21:52:10.283363 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 90/180] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:52:10.462416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f5aa51b6-3577-4387-92a0-908011341ab3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:10.463058 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f5aa51b6-3577-4387-92a0-908011341ab3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:10.483453 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f5aa51b6-3577-4387-92a0-908011341ab3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:10.487343 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f5aa51b6-3577-4387-92a0-908011341ab3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:10.493446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f5aa51b6-3577-4387-92a0-908011341ab3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:10.494322 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f5aa51b6-3577-4387-92a0-908011341ab3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:10.496795 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f5aa51b6-3577-4387-92a0-908011341ab3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:10.497528 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f5aa51b6-3577-4387-92a0-908011341ab3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:10.805511 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f5aa51b6-3577-4387-92a0-908011341ab3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:10.846878 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f5aa51b6-3577-4387-92a0-908011341ab3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1322 microversion: 2.1 time: 0.392747 Aug 29 21:52:10.866144 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 91/181] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:10 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:11.886369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6943cd5f-b5cf-485e-9d47-e2627108dc21 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:11.887198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-6943cd5f-b5cf-485e-9d47-e2627108dc21 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:11.899508 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6943cd5f-b5cf-485e-9d47-e2627108dc21 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:11.900060 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6943cd5f-b5cf-485e-9d47-e2627108dc21 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:11.900765 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6943cd5f-b5cf-485e-9d47-e2627108dc21 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:11.903467 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6943cd5f-b5cf-485e-9d47-e2627108dc21 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:11.904315 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6943cd5f-b5cf-485e-9d47-e2627108dc21 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:11.904946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6943cd5f-b5cf-485e-9d47-e2627108dc21 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:12.227569 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-6943cd5f-b5cf-485e-9d47-e2627108dc21 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:12.251307 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-6943cd5f-b5cf-485e-9d47-e2627108dc21 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1322 microversion: 2.1 time: 0.368997 Aug 29 21:52:12.263091 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 91/182] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:11 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:12.297884 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-67a0eb85-868e-4556-9c29-82c38e546c88 req-11903a8b-2ed4-494a-935d-fd47840226d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be8351b-602c-427c-915a-c0edd27cbfaf", "tag": "6e0d683b-55a7-46c5-b0b3-47db84b3a9a3"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:52:12.325600 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-67a0eb85-868e-4556-9c29-82c38e546c88 req-11903a8b-2ed4-494a-935d-fd47840226d7 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:12.325600 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-67a0eb85-868e-4556-9c29-82c38e546c88 req-11903a8b-2ed4-494a-935d-fd47840226d7 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:12.325600 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-67a0eb85-868e-4556-9c29-82c38e546c88 req-11903a8b-2ed4-494a-935d-fd47840226d7 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:12.342933 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-67a0eb85-868e-4556-9c29-82c38e546c88 req-11903a8b-2ed4-494a-935d-fd47840226d7 service nova] Creating event network-changed:6e0d683b-55a7-46c5-b0b3-47db84b3a9a3 for instance 1be8351b-602c-427c-915a-c0edd27cbfaf on hv-cinder-85426 Aug 29 21:52:12.350954 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-67a0eb85-868e-4556-9c29-82c38e546c88 req-11903a8b-2ed4-494a-935d-fd47840226d7 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058920 Aug 29 21:52:12.355617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 92/183] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:52:13.281402 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d9f7ba73-2092-4895-acad-9da2e30d9e9c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:13.285286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d9f7ba73-2092-4895-acad-9da2e30d9e9c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:13.296068 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d9f7ba73-2092-4895-acad-9da2e30d9e9c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:13.296647 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d9f7ba73-2092-4895-acad-9da2e30d9e9c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:13.297151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d9f7ba73-2092-4895-acad-9da2e30d9e9c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:13.298048 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d9f7ba73-2092-4895-acad-9da2e30d9e9c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:13.298589 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d9f7ba73-2092-4895-acad-9da2e30d9e9c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:13.299224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d9f7ba73-2092-4895-acad-9da2e30d9e9c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:13.470239 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d9f7ba73-2092-4895-acad-9da2e30d9e9c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:13.483946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d9f7ba73-2092-4895-acad-9da2e30d9e9c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1322 microversion: 2.1 time: 0.211515 Aug 29 21:52:13.484957 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 92/184] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:13 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:13.850995 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-5deab6e7-8b37-42ca-be00-7d107a5c60e7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:13.853375 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-5deab6e7-8b37-42ca-be00-7d107a5c60e7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:13.887972 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=4 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:13.890941 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5deab6e7-8b37-42ca-be00-7d107a5c60e7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:13.891758 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5deab6e7-8b37-42ca-be00-7d107a5c60e7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:13.896007 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5deab6e7-8b37-42ca-be00-7d107a5c60e7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:13.896007 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5deab6e7-8b37-42ca-be00-7d107a5c60e7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:13.896007 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5deab6e7-8b37-42ca-be00-7d107a5c60e7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:13.896007 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5deab6e7-8b37-42ca-be00-7d107a5c60e7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:13.956136 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-5deab6e7-8b37-42ca-be00-7d107a5c60e7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/ips" status: 200 len: 153 microversion: 2.20 time: 0.116856 Aug 29 21:52:13.957725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 93/185] 10.222.0.83 () {60 vars in 1289 bytes} [Mon Aug 29 21:52:13 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/ips => generated 153 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:52:14.519034 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0f59a66f-d81c-4f54-a43f-c23393ba77ee tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:14.521062 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-0f59a66f-d81c-4f54-a43f-c23393ba77ee tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:14.523423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=4 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:14.528135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0f59a66f-d81c-4f54-a43f-c23393ba77ee tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:14.528890 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0f59a66f-d81c-4f54-a43f-c23393ba77ee tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:14.529344 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0f59a66f-d81c-4f54-a43f-c23393ba77ee tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:14.530119 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0f59a66f-d81c-4f54-a43f-c23393ba77ee tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:14.530844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0f59a66f-d81c-4f54-a43f-c23393ba77ee tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:14.531696 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0f59a66f-d81c-4f54-a43f-c23393ba77ee tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:14.803509 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-0f59a66f-d81c-4f54-a43f-c23393ba77ee tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:14.818895 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-0f59a66f-d81c-4f54-a43f-c23393ba77ee tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1322 microversion: 2.1 time: 0.304252 Aug 29 21:52:14.819492 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 93/186] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:14 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:52:15.422931 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d0b6fccf-fc53-4540-8a1c-fbb2464e288d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:15.423529 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d0b6fccf-fc53-4540-8a1c-fbb2464e288d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:15.425722 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=14 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:15.435678 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0b6fccf-fc53-4540-8a1c-fbb2464e288d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:15.436937 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0b6fccf-fc53-4540-8a1c-fbb2464e288d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:15.437603 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0b6fccf-fc53-4540-8a1c-fbb2464e288d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:15.439143 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0b6fccf-fc53-4540-8a1c-fbb2464e288d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:15.440255 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0b6fccf-fc53-4540-8a1c-fbb2464e288d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:15.441332 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0b6fccf-fc53-4540-8a1c-fbb2464e288d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:15.505113 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d0b6fccf-fc53-4540-8a1c-fbb2464e288d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/ips" status: 200 len: 146 microversion: 2.1 time: 0.086463 Aug 29 21:52:15.506232 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 94/187] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 21:52:15 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/ips => generated 146 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:52:15.844156 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5674c55c-42e5-4f1c-87ae-cb6d6cdb6ce6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:15.844156 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5674c55c-42e5-4f1c-87ae-cb6d6cdb6ce6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:15.850806 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5674c55c-42e5-4f1c-87ae-cb6d6cdb6ce6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:15.851427 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5674c55c-42e5-4f1c-87ae-cb6d6cdb6ce6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:15.852229 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5674c55c-42e5-4f1c-87ae-cb6d6cdb6ce6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:15.852762 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5674c55c-42e5-4f1c-87ae-cb6d6cdb6ce6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:15.853320 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5674c55c-42e5-4f1c-87ae-cb6d6cdb6ce6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:15.853815 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5674c55c-42e5-4f1c-87ae-cb6d6cdb6ce6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:16.083187 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5674c55c-42e5-4f1c-87ae-cb6d6cdb6ce6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:16.112545 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5674c55c-42e5-4f1c-87ae-cb6d6cdb6ce6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1322 microversion: 2.1 time: 0.268908 Aug 29 21:52:16.112545 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 94/188] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:15 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:52:17.150847 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d681444d-4e49-42c9-bf28-0ae0a91715f3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:17.150847 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d681444d-4e49-42c9-bf28-0ae0a91715f3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:17.167468 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d681444d-4e49-42c9-bf28-0ae0a91715f3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:17.168383 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d681444d-4e49-42c9-bf28-0ae0a91715f3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:17.169423 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d681444d-4e49-42c9-bf28-0ae0a91715f3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:17.171186 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d681444d-4e49-42c9-bf28-0ae0a91715f3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:17.172546 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d681444d-4e49-42c9-bf28-0ae0a91715f3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:17.173545 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d681444d-4e49-42c9-bf28-0ae0a91715f3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:17.496037 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d681444d-4e49-42c9-bf28-0ae0a91715f3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:17.505816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d681444d-4e49-42c9-bf28-0ae0a91715f3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1322 microversion: 2.1 time: 0.364138 Aug 29 21:52:17.506954 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 95/189] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:17 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:17.640021 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-46eddd45-b26a-430c-88da-e1d5a93ed4e0 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:52:17.641502 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-46eddd45-b26a-430c-88da-e1d5a93ed4e0 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:17.649441 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-46eddd45-b26a-430c-88da-e1d5a93ed4e0 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:17.650048 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-46eddd45-b26a-430c-88da-e1d5a93ed4e0 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:17.650573 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-46eddd45-b26a-430c-88da-e1d5a93ed4e0 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:17.651687 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-46eddd45-b26a-430c-88da-e1d5a93ed4e0 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:17.653070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-46eddd45-b26a-430c-88da-e1d5a93ed4e0 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:17.653716 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-46eddd45-b26a-430c-88da-e1d5a93ed4e0 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:17.684219 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-46eddd45-b26a-430c-88da-e1d5a93ed4e0 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lazy-loading 'flavor' on Instance uuid 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:52:18.527750 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-10a12b81-ed3e-4870-98d9-8c20a03b373e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:18.528782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-10a12b81-ed3e-4870-98d9-8c20a03b373e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:18.540997 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10a12b81-ed3e-4870-98d9-8c20a03b373e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:18.549847 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10a12b81-ed3e-4870-98d9-8c20a03b373e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:18.550358 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10a12b81-ed3e-4870-98d9-8c20a03b373e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:18.551113 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10a12b81-ed3e-4870-98d9-8c20a03b373e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:18.551580 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10a12b81-ed3e-4870-98d9-8c20a03b373e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:18.552429 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10a12b81-ed3e-4870-98d9-8c20a03b373e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:18.562741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-46eddd45-b26a-430c-88da-e1d5a93ed4e0 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "POST /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/action" status: 202 len: 0 microversion: 2.20 time: 0.927738 Aug 29 21:52:18.578124 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 95/190] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 21:52:17 2022] POST /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/action => generated 0 bytes in 944 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:52:18.629910 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-266b4745-01ac-4781-8853-26e19194378e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:18.637254 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-266b4745-01ac-4781-8853-26e19194378e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:18.682352 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-266b4745-01ac-4781-8853-26e19194378e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:18.683173 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-266b4745-01ac-4781-8853-26e19194378e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:18.683924 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-266b4745-01ac-4781-8853-26e19194378e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:18.688174 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-266b4745-01ac-4781-8853-26e19194378e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:18.688977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-266b4745-01ac-4781-8853-26e19194378e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:18.689790 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-266b4745-01ac-4781-8853-26e19194378e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:19.056422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-266b4745-01ac-4781-8853-26e19194378e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:19.078779 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-266b4745-01ac-4781-8853-26e19194378e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:19.080932 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-266b4745-01ac-4781-8853-26e19194378e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:19.084543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-266b4745-01ac-4781-8853-26e19194378e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.501285 Aug 29 21:52:19.087660 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 96/191] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:18 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:19.139323 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-10a12b81-ed3e-4870-98d9-8c20a03b373e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:19.155281 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-10a12b81-ed3e-4870-98d9-8c20a03b373e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1322 microversion: 2.1 time: 0.631108 Aug 29 21:52:19.162942 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 96/192] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:18 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1322 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:52:19.661180 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-06c6d678-f784-42ee-ae1c-21f70e2269e7 req-f67ce04b-a723-454e-a653-68db858d6f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be8351b-602c-427c-915a-c0edd27cbfaf", "name": "network-vif-plugged", "status": "completed", "tag": "6e0d683b-55a7-46c5-b0b3-47db84b3a9a3"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:52:19.687892 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-06c6d678-f784-42ee-ae1c-21f70e2269e7 req-f67ce04b-a723-454e-a653-68db858d6f90 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:19.689934 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-06c6d678-f784-42ee-ae1c-21f70e2269e7 req-f67ce04b-a723-454e-a653-68db858d6f90 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:19.691129 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-06c6d678-f784-42ee-ae1c-21f70e2269e7 req-f67ce04b-a723-454e-a653-68db858d6f90 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:19.721059 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-06c6d678-f784-42ee-ae1c-21f70e2269e7 req-f67ce04b-a723-454e-a653-68db858d6f90 service nova] Creating event network-vif-plugged:6e0d683b-55a7-46c5-b0b3-47db84b3a9a3 for instance 1be8351b-602c-427c-915a-c0edd27cbfaf on hv-cinder-85426 Aug 29 21:52:19.733232 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-06c6d678-f784-42ee-ae1c-21f70e2269e7 req-f67ce04b-a723-454e-a653-68db858d6f90 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088415 Aug 29 21:52:19.734338 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 97/193] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:52:19.953735 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2468981c-9008-4f80-81d8-c44d1c6a4b27 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab2a4a6e-be26-4ae7-9f07-c01d98ce2b06"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:52:19.961550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2468981c-9008-4f80-81d8-c44d1c6a4b27 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:19.976328 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2468981c-9008-4f80-81d8-c44d1c6a4b27 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:19.979061 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2468981c-9008-4f80-81d8-c44d1c6a4b27 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:19.979520 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2468981c-9008-4f80-81d8-c44d1c6a4b27 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:19.982923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2468981c-9008-4f80-81d8-c44d1c6a4b27 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:19.983981 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2468981c-9008-4f80-81d8-c44d1c6a4b27 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:19.984871 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2468981c-9008-4f80-81d8-c44d1c6a4b27 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:20.154385 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-deb524f8-cb4d-4891-a219-85add4a22dc6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:20.156689 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-deb524f8-cb4d-4891-a219-85add4a22dc6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:20.183295 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-deb524f8-cb4d-4891-a219-85add4a22dc6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:20.187833 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-deb524f8-cb4d-4891-a219-85add4a22dc6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:20.217070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-deb524f8-cb4d-4891-a219-85add4a22dc6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:20.223787 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-deb524f8-cb4d-4891-a219-85add4a22dc6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:20.224303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-deb524f8-cb4d-4891-a219-85add4a22dc6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:20.224816 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-deb524f8-cb4d-4891-a219-85add4a22dc6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:20.875601 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-deb524f8-cb4d-4891-a219-85add4a22dc6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:20.885904 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-deb524f8-cb4d-4891-a219-85add4a22dc6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:20.889782 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-deb524f8-cb4d-4891-a219-85add4a22dc6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:20.894248 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-deb524f8-cb4d-4891-a219-85add4a22dc6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.765755 Aug 29 21:52:20.899814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 98/194] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:20 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:20.910537 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-92ab1321-4f53-481b-9920-da764569f7a4 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:20.911204 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-92ab1321-4f53-481b-9920-da764569f7a4 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:20.930090 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92ab1321-4f53-481b-9920-da764569f7a4 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:20.931047 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92ab1321-4f53-481b-9920-da764569f7a4 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:20.931941 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92ab1321-4f53-481b-9920-da764569f7a4 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:20.932947 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92ab1321-4f53-481b-9920-da764569f7a4 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:20.937857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92ab1321-4f53-481b-9920-da764569f7a4 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:20.951929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92ab1321-4f53-481b-9920-da764569f7a4 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:21.394204 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-92ab1321-4f53-481b-9920-da764569f7a4 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:21.404010 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-92ab1321-4f53-481b-9920-da764569f7a4 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1322 microversion: 2.1 time: 0.502752 Aug 29 21:52:21.405272 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 99/195] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:20 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:21.419460 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2468981c-9008-4f80-81d8-c44d1c6a4b27 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "POST /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.470270 Aug 29 21:52:21.422937 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 97/196] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 21:52:19 2022] POST /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/os-volume_attachments => generated 194 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:52:21.826939 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-317ede7d-7178-453b-8d7a-38a1111cd257 req-b05cbb2e-6053-4f72-8d7b-3f12cd36b06b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a4fc48-d58f-4227-a8aa-5d4d227c33d8", "name": "network-vif-plugged", "status": "completed", "tag": "15cd5989-a04d-4d6e-9c81-fdd78d421299"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:52:21.852044 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-317ede7d-7178-453b-8d7a-38a1111cd257 req-b05cbb2e-6053-4f72-8d7b-3f12cd36b06b service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:21.855223 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-317ede7d-7178-453b-8d7a-38a1111cd257 req-b05cbb2e-6053-4f72-8d7b-3f12cd36b06b service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:21.855982 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-317ede7d-7178-453b-8d7a-38a1111cd257 req-b05cbb2e-6053-4f72-8d7b-3f12cd36b06b service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:21.876181 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-317ede7d-7178-453b-8d7a-38a1111cd257 req-b05cbb2e-6053-4f72-8d7b-3f12cd36b06b service nova] Creating event network-vif-plugged:15cd5989-a04d-4d6e-9c81-fdd78d421299 for instance 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 on hv-cinder-85426 Aug 29 21:52:21.885942 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-317ede7d-7178-453b-8d7a-38a1111cd257 req-b05cbb2e-6053-4f72-8d7b-3f12cd36b06b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063151 Aug 29 21:52:21.887306 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 100/197] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:52:21.946700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2bfe2c6c-8ebc-40e2-90fa-6543e39d18c7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:21.947775 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2bfe2c6c-8ebc-40e2-90fa-6543e39d18c7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:21.965547 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2bfe2c6c-8ebc-40e2-90fa-6543e39d18c7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:21.966410 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2bfe2c6c-8ebc-40e2-90fa-6543e39d18c7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:21.968087 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2bfe2c6c-8ebc-40e2-90fa-6543e39d18c7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:21.969993 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2bfe2c6c-8ebc-40e2-90fa-6543e39d18c7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:21.971477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2bfe2c6c-8ebc-40e2-90fa-6543e39d18c7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:21.974772 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2bfe2c6c-8ebc-40e2-90fa-6543e39d18c7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:22.262157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2bfe2c6c-8ebc-40e2-90fa-6543e39d18c7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:22.274495 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2bfe2c6c-8ebc-40e2-90fa-6543e39d18c7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:22.276144 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2bfe2c6c-8ebc-40e2-90fa-6543e39d18c7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:22.278204 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2bfe2c6c-8ebc-40e2-90fa-6543e39d18c7 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.337886 Aug 29 21:52:22.286998 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 98/198] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:21 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:22.440677 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-216c6c76-ab5c-43b7-be7e-45e589054351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:22.441365 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-216c6c76-ab5c-43b7-be7e-45e589054351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:22.459827 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-216c6c76-ab5c-43b7-be7e-45e589054351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:22.460376 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-216c6c76-ab5c-43b7-be7e-45e589054351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:22.461217 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-216c6c76-ab5c-43b7-be7e-45e589054351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:22.470344 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-216c6c76-ab5c-43b7-be7e-45e589054351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:22.470344 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-216c6c76-ab5c-43b7-be7e-45e589054351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:22.470344 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-216c6c76-ab5c-43b7-be7e-45e589054351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:22.693704 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-216c6c76-ab5c-43b7-be7e-45e589054351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:22.707859 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-216c6c76-ab5c-43b7-be7e-45e589054351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1322 microversion: 2.1 time: 0.279556 Aug 29 21:52:22.709692 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 101/199] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:22 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:23.304344 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a4c8e7c0-a0a7-4e9f-90b5-516e44439551 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:23.305008 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a4c8e7c0-a0a7-4e9f-90b5-516e44439551 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:23.323580 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a4c8e7c0-a0a7-4e9f-90b5-516e44439551 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:23.329004 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a4c8e7c0-a0a7-4e9f-90b5-516e44439551 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:23.329004 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a4c8e7c0-a0a7-4e9f-90b5-516e44439551 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:23.329004 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a4c8e7c0-a0a7-4e9f-90b5-516e44439551 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:23.329004 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a4c8e7c0-a0a7-4e9f-90b5-516e44439551 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:23.329334 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a4c8e7c0-a0a7-4e9f-90b5-516e44439551 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:23.621160 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a4c8e7c0-a0a7-4e9f-90b5-516e44439551 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:23.634854 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a4c8e7c0-a0a7-4e9f-90b5-516e44439551 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:23.636424 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a4c8e7c0-a0a7-4e9f-90b5-516e44439551 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:23.637681 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a4c8e7c0-a0a7-4e9f-90b5-516e44439551 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.338353 Aug 29 21:52:23.640625 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 99/200] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:23 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:23.730350 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ed4900e3-faac-4b2c-b7fa-88f16f14b40d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:23.731108 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ed4900e3-faac-4b2c-b7fa-88f16f14b40d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:23.740807 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed4900e3-faac-4b2c-b7fa-88f16f14b40d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:23.741799 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed4900e3-faac-4b2c-b7fa-88f16f14b40d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:23.742314 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed4900e3-faac-4b2c-b7fa-88f16f14b40d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:23.743293 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed4900e3-faac-4b2c-b7fa-88f16f14b40d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:23.743968 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed4900e3-faac-4b2c-b7fa-88f16f14b40d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:23.744730 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed4900e3-faac-4b2c-b7fa-88f16f14b40d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:24.060619 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ed4900e3-faac-4b2c-b7fa-88f16f14b40d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:24.083594 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ed4900e3-faac-4b2c-b7fa-88f16f14b40d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1515 microversion: 2.1 time: 0.351069 Aug 29 21:52:24.089864 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 102/201] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:23 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1515 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:24.101111 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a19ee909-15b6-4533-b235-4b6b69166948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:52:24.106351 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a19ee909-15b6-4533-b235-4b6b69166948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:24.111687 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a19ee909-15b6-4533-b235-4b6b69166948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:24.112223 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a19ee909-15b6-4533-b235-4b6b69166948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:24.112744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a19ee909-15b6-4533-b235-4b6b69166948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:24.113784 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a19ee909-15b6-4533-b235-4b6b69166948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:24.114261 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a19ee909-15b6-4533-b235-4b6b69166948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:24.114698 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a19ee909-15b6-4533-b235-4b6b69166948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:24.145810 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-a19ee909-15b6-4533-b235-4b6b69166948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lazy-loading 'flavor' on Instance uuid 1be8351b-602c-427c-915a-c0edd27cbfaf {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:52:24.602514 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a19ee909-15b6-4533-b235-4b6b69166948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "POST /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf/action" status: 200 len: 32 microversion: 2.1 time: 0.501113 Aug 29 21:52:24.602514 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 100/202] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 21:52:24 2022] POST /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf/action => generated 32 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 21:52:24.608793 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a5a57462-da0b-4c44-84d6-b9e09378cae5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:24.609418 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a5a57462-da0b-4c44-84d6-b9e09378cae5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:24.618205 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a5a57462-da0b-4c44-84d6-b9e09378cae5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:24.618718 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a5a57462-da0b-4c44-84d6-b9e09378cae5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:24.619169 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a5a57462-da0b-4c44-84d6-b9e09378cae5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:24.642007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a5a57462-da0b-4c44-84d6-b9e09378cae5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:24.642007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a5a57462-da0b-4c44-84d6-b9e09378cae5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:24.642007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a5a57462-da0b-4c44-84d6-b9e09378cae5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:24.650226 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:24.685111 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-573f957d-15d6-4ae0-89b6-d0de8f2d5ff5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:24.687295 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-573f957d-15d6-4ae0-89b6-d0de8f2d5ff5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:24.712112 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-573f957d-15d6-4ae0-89b6-d0de8f2d5ff5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:24.717626 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-573f957d-15d6-4ae0-89b6-d0de8f2d5ff5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:24.718512 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-573f957d-15d6-4ae0-89b6-d0de8f2d5ff5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:24.721050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-573f957d-15d6-4ae0-89b6-d0de8f2d5ff5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:24.721658 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-573f957d-15d6-4ae0-89b6-d0de8f2d5ff5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:24.722110 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-573f957d-15d6-4ae0-89b6-d0de8f2d5ff5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:24.985781 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-573f957d-15d6-4ae0-89b6-d0de8f2d5ff5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:24.997538 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-573f957d-15d6-4ae0-89b6-d0de8f2d5ff5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:25.014462 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-573f957d-15d6-4ae0-89b6-d0de8f2d5ff5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:25.021046 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-573f957d-15d6-4ae0-89b6-d0de8f2d5ff5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.360437 Aug 29 21:52:25.037656 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 101/203] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:24 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:25.328092 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a08c8150-1693-4fed-ba55-4890c6a06767 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:52:25.357133 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a08c8150-1693-4fed-ba55-4890c6a06767 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:25.358472 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a08c8150-1693-4fed-ba55-4890c6a06767 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:25.359565 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a08c8150-1693-4fed-ba55-4890c6a06767 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:25.413645 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a5a57462-da0b-4c44-84d6-b9e09378cae5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:25.434954 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a5a57462-da0b-4c44-84d6-b9e09378cae5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.831082 Aug 29 21:52:25.435937 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 103/204] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:24 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:25.509446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a08c8150-1693-4fed-ba55-4890c6a06767 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Going to try to stop instance {{(pid=127883) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 21:52:25.546761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:25.805202 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a08c8150-1693-4fed-ba55-4890c6a06767 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "POST /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/action" status: 202 len: 0 microversion: 2.1 time: 0.488790 Aug 29 21:52:25.806997 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 102/205] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 21:52:25 2022] POST /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:52:25.818170 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-958ab330-85a5-43ae-bebe-52d431cab283 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:25.818784 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-958ab330-85a5-43ae-bebe-52d431cab283 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:25.827321 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-958ab330-85a5-43ae-bebe-52d431cab283 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:25.829619 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-958ab330-85a5-43ae-bebe-52d431cab283 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:25.830638 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-958ab330-85a5-43ae-bebe-52d431cab283 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:25.834449 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-958ab330-85a5-43ae-bebe-52d431cab283 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:25.835131 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-958ab330-85a5-43ae-bebe-52d431cab283 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:25.835718 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-958ab330-85a5-43ae-bebe-52d431cab283 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:26.060331 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0ac9c127-4ea9-44ee-8920-868c6cbc3757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:26.062176 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0ac9c127-4ea9-44ee-8920-868c6cbc3757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:26.074465 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0ac9c127-4ea9-44ee-8920-868c6cbc3757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:26.075546 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0ac9c127-4ea9-44ee-8920-868c6cbc3757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:26.076159 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0ac9c127-4ea9-44ee-8920-868c6cbc3757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:26.077714 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0ac9c127-4ea9-44ee-8920-868c6cbc3757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:26.078363 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0ac9c127-4ea9-44ee-8920-868c6cbc3757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:26.079520 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0ac9c127-4ea9-44ee-8920-868c6cbc3757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:26.121539 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-958ab330-85a5-43ae-bebe-52d431cab283 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:26.130724 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-958ab330-85a5-43ae-bebe-52d431cab283 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1722 microversion: 2.1 time: 0.316959 Aug 29 21:52:26.148097 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 104/206] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:25 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1722 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:26.349410 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0ac9c127-4ea9-44ee-8920-868c6cbc3757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:26.355518 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0ac9c127-4ea9-44ee-8920-868c6cbc3757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:26.357056 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0ac9c127-4ea9-44ee-8920-868c6cbc3757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:26.358453 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0ac9c127-4ea9-44ee-8920-868c6cbc3757 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.304579 Aug 29 21:52:26.359031 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 103/207] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:26 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:52:26.473028 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-14092c6f-b107-4ddd-a780-86a23a28ffe0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:26.473647 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-14092c6f-b107-4ddd-a780-86a23a28ffe0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:26.490252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14092c6f-b107-4ddd-a780-86a23a28ffe0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:26.490761 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14092c6f-b107-4ddd-a780-86a23a28ffe0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:26.491200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14092c6f-b107-4ddd-a780-86a23a28ffe0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:26.491915 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14092c6f-b107-4ddd-a780-86a23a28ffe0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:26.492366 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14092c6f-b107-4ddd-a780-86a23a28ffe0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:26.492824 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14092c6f-b107-4ddd-a780-86a23a28ffe0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:27.053171 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-14092c6f-b107-4ddd-a780-86a23a28ffe0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:27.061852 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-14092c6f-b107-4ddd-a780-86a23a28ffe0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.593100 Aug 29 21:52:27.062495 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 105/208] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:26 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:27.155414 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-79eadfb2-87f9-4dbf-a4d7-42004225d7eb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:27.156952 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-79eadfb2-87f9-4dbf-a4d7-42004225d7eb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:27.171261 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79eadfb2-87f9-4dbf-a4d7-42004225d7eb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:27.172217 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79eadfb2-87f9-4dbf-a4d7-42004225d7eb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:27.172937 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79eadfb2-87f9-4dbf-a4d7-42004225d7eb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:27.174618 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79eadfb2-87f9-4dbf-a4d7-42004225d7eb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:27.177665 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79eadfb2-87f9-4dbf-a4d7-42004225d7eb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:27.178522 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79eadfb2-87f9-4dbf-a4d7-42004225d7eb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:27.383295 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2a0289bf-b16e-439a-b818-18900d1cfb9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:27.383817 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2a0289bf-b16e-439a-b818-18900d1cfb9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:27.389910 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-79eadfb2-87f9-4dbf-a4d7-42004225d7eb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:27.390745 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a0289bf-b16e-439a-b818-18900d1cfb9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:27.391231 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a0289bf-b16e-439a-b818-18900d1cfb9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:27.391664 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a0289bf-b16e-439a-b818-18900d1cfb9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:27.392361 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a0289bf-b16e-439a-b818-18900d1cfb9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:27.392838 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a0289bf-b16e-439a-b818-18900d1cfb9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:27.393262 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a0289bf-b16e-439a-b818-18900d1cfb9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:27.403473 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-79eadfb2-87f9-4dbf-a4d7-42004225d7eb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1722 microversion: 2.1 time: 0.252017 Aug 29 21:52:27.404815 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 104/209] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:27 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:27.645537 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2a0289bf-b16e-439a-b818-18900d1cfb9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:27.655497 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2a0289bf-b16e-439a-b818-18900d1cfb9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:27.657282 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2a0289bf-b16e-439a-b818-18900d1cfb9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:27.659062 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2a0289bf-b16e-439a-b818-18900d1cfb9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.280315 Aug 29 21:52:27.673418 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 106/210] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:27 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:52:28.082774 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0054c59e-b6dd-4b58-b0aa-7c9e1cca202d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:28.083313 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0054c59e-b6dd-4b58-b0aa-7c9e1cca202d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:28.092871 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0054c59e-b6dd-4b58-b0aa-7c9e1cca202d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:28.097665 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0054c59e-b6dd-4b58-b0aa-7c9e1cca202d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:28.097665 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0054c59e-b6dd-4b58-b0aa-7c9e1cca202d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:28.098722 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0054c59e-b6dd-4b58-b0aa-7c9e1cca202d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:28.101552 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0054c59e-b6dd-4b58-b0aa-7c9e1cca202d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:28.102713 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0054c59e-b6dd-4b58-b0aa-7c9e1cca202d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:28.429041 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-10b9d3c5-dadd-477b-961c-14fa9b858950 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:28.429041 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-10b9d3c5-dadd-477b-961c-14fa9b858950 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:28.436457 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10b9d3c5-dadd-477b-961c-14fa9b858950 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:28.438360 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10b9d3c5-dadd-477b-961c-14fa9b858950 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:28.439116 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10b9d3c5-dadd-477b-961c-14fa9b858950 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:28.440237 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10b9d3c5-dadd-477b-961c-14fa9b858950 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:28.441010 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10b9d3c5-dadd-477b-961c-14fa9b858950 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:28.441735 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10b9d3c5-dadd-477b-961c-14fa9b858950 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:28.488312 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0054c59e-b6dd-4b58-b0aa-7c9e1cca202d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:28.515619 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0054c59e-b6dd-4b58-b0aa-7c9e1cca202d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.436755 Aug 29 21:52:28.519003 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 105/211] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:28 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:28.686932 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2e7f5523-4b6b-48b2-9dcf-c1eb226dd951 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:28.687741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2e7f5523-4b6b-48b2-9dcf-c1eb226dd951 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:28.703636 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2e7f5523-4b6b-48b2-9dcf-c1eb226dd951 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:28.707732 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2e7f5523-4b6b-48b2-9dcf-c1eb226dd951 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:28.712215 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2e7f5523-4b6b-48b2-9dcf-c1eb226dd951 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:28.715868 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2e7f5523-4b6b-48b2-9dcf-c1eb226dd951 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:28.716666 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2e7f5523-4b6b-48b2-9dcf-c1eb226dd951 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:28.717405 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2e7f5523-4b6b-48b2-9dcf-c1eb226dd951 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:28.799353 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-10b9d3c5-dadd-477b-961c-14fa9b858950 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:28.828155 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-10b9d3c5-dadd-477b-961c-14fa9b858950 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1722 microversion: 2.1 time: 0.404542 Aug 29 21:52:28.834962 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 107/212] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:28 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1722 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:52:29.130107 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2e7f5523-4b6b-48b2-9dcf-c1eb226dd951 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:29.142692 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2e7f5523-4b6b-48b2-9dcf-c1eb226dd951 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:29.145067 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2e7f5523-4b6b-48b2-9dcf-c1eb226dd951 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:29.146294 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2e7f5523-4b6b-48b2-9dcf-c1eb226dd951 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.466800 Aug 29 21:52:29.146876 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 106/213] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:28 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:29.540472 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c63f32fc-1ef3-4885-87ab-090a99f0bdec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:29.541109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c63f32fc-1ef3-4885-87ab-090a99f0bdec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:29.554816 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c63f32fc-1ef3-4885-87ab-090a99f0bdec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:29.555298 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c63f32fc-1ef3-4885-87ab-090a99f0bdec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:29.559948 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c63f32fc-1ef3-4885-87ab-090a99f0bdec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:29.561049 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c63f32fc-1ef3-4885-87ab-090a99f0bdec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:29.561701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c63f32fc-1ef3-4885-87ab-090a99f0bdec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:29.562886 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c63f32fc-1ef3-4885-87ab-090a99f0bdec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:29.864924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-316ffcc7-971e-4feb-9235-f244760aab59 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:29.865946 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-316ffcc7-971e-4feb-9235-f244760aab59 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:29.894484 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-316ffcc7-971e-4feb-9235-f244760aab59 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:29.896020 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-316ffcc7-971e-4feb-9235-f244760aab59 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:29.902974 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-316ffcc7-971e-4feb-9235-f244760aab59 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:29.903742 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-316ffcc7-971e-4feb-9235-f244760aab59 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:29.904225 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-316ffcc7-971e-4feb-9235-f244760aab59 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:29.905382 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-316ffcc7-971e-4feb-9235-f244760aab59 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:29.945819 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c63f32fc-1ef3-4885-87ab-090a99f0bdec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:29.963291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c63f32fc-1ef3-4885-87ab-090a99f0bdec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.427021 Aug 29 21:52:29.966963 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 108/214] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:29 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:30.164721 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-316ffcc7-971e-4feb-9235-f244760aab59 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:30.171083 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a08aab32-8b18-4802-b8fc-87c26fd0355a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:30.171730 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a08aab32-8b18-4802-b8fc-87c26fd0355a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:30.181352 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a08aab32-8b18-4802-b8fc-87c26fd0355a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:30.181844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a08aab32-8b18-4802-b8fc-87c26fd0355a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:30.182277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a08aab32-8b18-4802-b8fc-87c26fd0355a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:30.182783 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-316ffcc7-971e-4feb-9235-f244760aab59 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1722 microversion: 2.1 time: 0.327849 Aug 29 21:52:30.194022 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a08aab32-8b18-4802-b8fc-87c26fd0355a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:30.195171 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a08aab32-8b18-4802-b8fc-87c26fd0355a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:30.195171 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a08aab32-8b18-4802-b8fc-87c26fd0355a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:30.200454 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 107/215] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:29 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1722 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:30.837902 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a08aab32-8b18-4802-b8fc-87c26fd0355a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:30.849773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a08aab32-8b18-4802-b8fc-87c26fd0355a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:30.852166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a08aab32-8b18-4802-b8fc-87c26fd0355a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:30.854083 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a08aab32-8b18-4802-b8fc-87c26fd0355a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.687945 Aug 29 21:52:30.855663 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 109/216] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:30 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:52:30.991811 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-3a90e4a2-4e16-412f-9237-fb2198580a7b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:30.992588 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-3a90e4a2-4e16-412f-9237-fb2198580a7b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:31.006693 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3a90e4a2-4e16-412f-9237-fb2198580a7b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:31.007368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3a90e4a2-4e16-412f-9237-fb2198580a7b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:31.009842 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3a90e4a2-4e16-412f-9237-fb2198580a7b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:31.011414 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3a90e4a2-4e16-412f-9237-fb2198580a7b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:31.021968 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3a90e4a2-4e16-412f-9237-fb2198580a7b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:31.021968 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3a90e4a2-4e16-412f-9237-fb2198580a7b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:31.214186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-210d8e1e-a904-423e-8840-57dad56c4223 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:31.215300 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-210d8e1e-a904-423e-8840-57dad56c4223 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:31.235059 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-210d8e1e-a904-423e-8840-57dad56c4223 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:31.235059 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-210d8e1e-a904-423e-8840-57dad56c4223 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:31.235059 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-210d8e1e-a904-423e-8840-57dad56c4223 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:31.235059 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-210d8e1e-a904-423e-8840-57dad56c4223 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:31.239838 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-210d8e1e-a904-423e-8840-57dad56c4223 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:31.239838 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-210d8e1e-a904-423e-8840-57dad56c4223 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:31.504018 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-3a90e4a2-4e16-412f-9237-fb2198580a7b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:31.514524 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-3a90e4a2-4e16-412f-9237-fb2198580a7b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.527390 Aug 29 21:52:31.519290 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 108/217] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:30 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:31.587563 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-210d8e1e-a904-423e-8840-57dad56c4223 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:31.597487 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-210d8e1e-a904-423e-8840-57dad56c4223 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1722 microversion: 2.1 time: 0.388815 Aug 29 21:52:31.598543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 110/218] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:31 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1722 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:31.877709 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-66994614-b9e0-44ae-bfe5-415c73811cbe tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:31.878380 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-66994614-b9e0-44ae-bfe5-415c73811cbe tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:31.884952 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-66994614-b9e0-44ae-bfe5-415c73811cbe tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:31.897694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-66994614-b9e0-44ae-bfe5-415c73811cbe tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:31.898615 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-66994614-b9e0-44ae-bfe5-415c73811cbe tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:31.900372 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-66994614-b9e0-44ae-bfe5-415c73811cbe tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:31.902184 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-66994614-b9e0-44ae-bfe5-415c73811cbe tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:31.903357 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-66994614-b9e0-44ae-bfe5-415c73811cbe tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:32.401550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-66994614-b9e0-44ae-bfe5-415c73811cbe tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:32.414132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-66994614-b9e0-44ae-bfe5-415c73811cbe tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:32.415480 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-66994614-b9e0-44ae-bfe5-415c73811cbe tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:32.416735 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-66994614-b9e0-44ae-bfe5-415c73811cbe tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.543357 Aug 29 21:52:32.434685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 109/219] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:31 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:32.535733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-8cf0b486-71b9-486d-afc6-a9ffeecd67ed tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:32.536602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-8cf0b486-71b9-486d-afc6-a9ffeecd67ed tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:32.545159 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cf0b486-71b9-486d-afc6-a9ffeecd67ed tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:32.549073 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cf0b486-71b9-486d-afc6-a9ffeecd67ed tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:32.549534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cf0b486-71b9-486d-afc6-a9ffeecd67ed tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:32.550287 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cf0b486-71b9-486d-afc6-a9ffeecd67ed tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:32.550757 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cf0b486-71b9-486d-afc6-a9ffeecd67ed tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:32.551191 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cf0b486-71b9-486d-afc6-a9ffeecd67ed tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:32.626578 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2e6e3776-b1e2-4326-9f0a-88c5b3c0cfef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:32.627675 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2e6e3776-b1e2-4326-9f0a-88c5b3c0cfef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:32.677236 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2e6e3776-b1e2-4326-9f0a-88c5b3c0cfef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:32.689876 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2e6e3776-b1e2-4326-9f0a-88c5b3c0cfef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:32.690565 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2e6e3776-b1e2-4326-9f0a-88c5b3c0cfef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:32.691563 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2e6e3776-b1e2-4326-9f0a-88c5b3c0cfef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:32.692264 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2e6e3776-b1e2-4326-9f0a-88c5b3c0cfef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:32.693008 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2e6e3776-b1e2-4326-9f0a-88c5b3c0cfef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:32.835909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-8cf0b486-71b9-486d-afc6-a9ffeecd67ed tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:32.853357 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-8cf0b486-71b9-486d-afc6-a9ffeecd67ed tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.321475 Aug 29 21:52:32.859125 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 111/220] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:32 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:52:32.895748 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2e6e3776-b1e2-4326-9f0a-88c5b3c0cfef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:32.906031 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2e6e3776-b1e2-4326-9f0a-88c5b3c0cfef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1722 microversion: 2.1 time: 0.287026 Aug 29 21:52:32.906793 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 110/221] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:32 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:33.446440 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-91e92d19-2bd0-49fb-a827-51f9d5e2b1b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:33.447267 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-91e92d19-2bd0-49fb-a827-51f9d5e2b1b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:33.466607 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-91e92d19-2bd0-49fb-a827-51f9d5e2b1b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:33.467609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-91e92d19-2bd0-49fb-a827-51f9d5e2b1b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:33.468366 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-91e92d19-2bd0-49fb-a827-51f9d5e2b1b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:33.469950 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-91e92d19-2bd0-49fb-a827-51f9d5e2b1b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:33.470979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-91e92d19-2bd0-49fb-a827-51f9d5e2b1b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:33.471690 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-91e92d19-2bd0-49fb-a827-51f9d5e2b1b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:33.750967 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-91e92d19-2bd0-49fb-a827-51f9d5e2b1b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:33.768149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-91e92d19-2bd0-49fb-a827-51f9d5e2b1b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:33.770435 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-91e92d19-2bd0-49fb-a827-51f9d5e2b1b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:33.771950 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-91e92d19-2bd0-49fb-a827-51f9d5e2b1b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.334008 Aug 29 21:52:33.788060 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 112/222] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:33 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:33.893291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-88b0003a-2c93-47f2-b54c-392e9662a0eb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:33.893986 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-88b0003a-2c93-47f2-b54c-392e9662a0eb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:33.896441 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:33.902716 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-88b0003a-2c93-47f2-b54c-392e9662a0eb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:33.903585 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-88b0003a-2c93-47f2-b54c-392e9662a0eb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:33.904257 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-88b0003a-2c93-47f2-b54c-392e9662a0eb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:33.905275 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-88b0003a-2c93-47f2-b54c-392e9662a0eb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:33.905976 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-88b0003a-2c93-47f2-b54c-392e9662a0eb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:33.906629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-88b0003a-2c93-47f2-b54c-392e9662a0eb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:33.944095 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-af393218-2e33-43a3-af0d-118bd6647c33 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:33.947861 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-af393218-2e33-43a3-af0d-118bd6647c33 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:33.963497 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-af393218-2e33-43a3-af0d-118bd6647c33 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:33.966367 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-af393218-2e33-43a3-af0d-118bd6647c33 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:33.967385 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-af393218-2e33-43a3-af0d-118bd6647c33 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:33.970115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-af393218-2e33-43a3-af0d-118bd6647c33 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:33.973923 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-af393218-2e33-43a3-af0d-118bd6647c33 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:33.973923 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-af393218-2e33-43a3-af0d-118bd6647c33 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:34.185333 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-88b0003a-2c93-47f2-b54c-392e9662a0eb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:34.200611 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-88b0003a-2c93-47f2-b54c-392e9662a0eb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.312142 Aug 29 21:52:34.203233 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 111/223] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:33 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:34.213765 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-af393218-2e33-43a3-af0d-118bd6647c33 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:34.222933 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-af393218-2e33-43a3-af0d-118bd6647c33 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1722 microversion: 2.1 time: 0.294123 Aug 29 21:52:34.224047 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 113/224] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:33 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:34.797832 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-665e1431-bdcc-46e8-9251-d568b3bb88df tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:34.798454 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-665e1431-bdcc-46e8-9251-d568b3bb88df tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:34.826740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-665e1431-bdcc-46e8-9251-d568b3bb88df tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:34.831956 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-665e1431-bdcc-46e8-9251-d568b3bb88df tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:34.832736 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-665e1431-bdcc-46e8-9251-d568b3bb88df tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:34.837043 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-665e1431-bdcc-46e8-9251-d568b3bb88df tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:34.837043 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-665e1431-bdcc-46e8-9251-d568b3bb88df tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:34.837043 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-665e1431-bdcc-46e8-9251-d568b3bb88df tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:35.088620 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-665e1431-bdcc-46e8-9251-d568b3bb88df tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:35.099183 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-665e1431-bdcc-46e8-9251-d568b3bb88df tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:35.101071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-665e1431-bdcc-46e8-9251-d568b3bb88df tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:35.102418 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-665e1431-bdcc-46e8-9251-d568b3bb88df tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1745 microversion: 2.20 time: 0.308867 Aug 29 21:52:35.103048 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 112/225] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:34 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1745 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:35.223706 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b5e3f72b-bcb8-4653-b484-7fd732c9cc5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:35.224323 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b5e3f72b-bcb8-4653-b484-7fd732c9cc5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:35.233603 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5e3f72b-bcb8-4653-b484-7fd732c9cc5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:35.234339 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5e3f72b-bcb8-4653-b484-7fd732c9cc5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:35.234782 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5e3f72b-bcb8-4653-b484-7fd732c9cc5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:35.235725 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5e3f72b-bcb8-4653-b484-7fd732c9cc5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:35.236238 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5e3f72b-bcb8-4653-b484-7fd732c9cc5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:35.236623 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5e3f72b-bcb8-4653-b484-7fd732c9cc5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:35.247495 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-92a8fd70-4327-46bd-9072-bf865c459ecb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:35.248172 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-92a8fd70-4327-46bd-9072-bf865c459ecb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:35.266070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92a8fd70-4327-46bd-9072-bf865c459ecb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:35.266938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92a8fd70-4327-46bd-9072-bf865c459ecb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:35.267542 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92a8fd70-4327-46bd-9072-bf865c459ecb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:35.268442 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92a8fd70-4327-46bd-9072-bf865c459ecb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:35.268935 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92a8fd70-4327-46bd-9072-bf865c459ecb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:35.269359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92a8fd70-4327-46bd-9072-bf865c459ecb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:35.519578 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b5e3f72b-bcb8-4653-b484-7fd732c9cc5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:35.532035 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b5e3f72b-bcb8-4653-b484-7fd732c9cc5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.311637 Aug 29 21:52:35.545650 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 114/226] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:35 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:35.668363 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-92a8fd70-4327-46bd-9072-bf865c459ecb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:35.680702 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-92a8fd70-4327-46bd-9072-bf865c459ecb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1722 microversion: 2.1 time: 0.437180 Aug 29 21:52:35.690631 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 113/227] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:35 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1722 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:36.134063 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e546e02d-ea66-46d9-bf1a-896409dfcb82 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:36.137087 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-e546e02d-ea66-46d9-bf1a-896409dfcb82 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:36.180431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e546e02d-ea66-46d9-bf1a-896409dfcb82 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:36.181336 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e546e02d-ea66-46d9-bf1a-896409dfcb82 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:36.182108 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e546e02d-ea66-46d9-bf1a-896409dfcb82 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:36.183650 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e546e02d-ea66-46d9-bf1a-896409dfcb82 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:36.184740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e546e02d-ea66-46d9-bf1a-896409dfcb82 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:36.188829 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e546e02d-ea66-46d9-bf1a-896409dfcb82 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:36.395027 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e546e02d-ea66-46d9-bf1a-896409dfcb82 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:36.405091 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e546e02d-ea66-46d9-bf1a-896409dfcb82 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:36.406825 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e546e02d-ea66-46d9-bf1a-896409dfcb82 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:36.408290 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e546e02d-ea66-46d9-bf1a-896409dfcb82 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1745 microversion: 2.20 time: 0.284511 Aug 29 21:52:36.424177 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 115/228] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:36 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1745 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:36.556555 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-beb81cb3-b6d3-4fe0-847b-895c60af926c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:36.559452 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-beb81cb3-b6d3-4fe0-847b-895c60af926c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:36.570864 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-beb81cb3-b6d3-4fe0-847b-895c60af926c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:36.571667 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-beb81cb3-b6d3-4fe0-847b-895c60af926c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:36.572384 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-beb81cb3-b6d3-4fe0-847b-895c60af926c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:36.574537 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-beb81cb3-b6d3-4fe0-847b-895c60af926c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:36.575301 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-beb81cb3-b6d3-4fe0-847b-895c60af926c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:36.576172 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-beb81cb3-b6d3-4fe0-847b-895c60af926c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:36.906964 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-beb81cb3-b6d3-4fe0-847b-895c60af926c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:36.913462 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-beb81cb3-b6d3-4fe0-847b-895c60af926c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.361713 Aug 29 21:52:36.921079 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 114/229] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:36 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:36.930447 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-29b309f3-4f79-46e2-a7c5-5d167b1d5a5f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:36.931081 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-29b309f3-4f79-46e2-a7c5-5d167b1d5a5f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:36.944590 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-29b309f3-4f79-46e2-a7c5-5d167b1d5a5f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:36.945318 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-29b309f3-4f79-46e2-a7c5-5d167b1d5a5f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:36.946018 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-29b309f3-4f79-46e2-a7c5-5d167b1d5a5f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:36.946935 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-29b309f3-4f79-46e2-a7c5-5d167b1d5a5f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:36.947587 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-29b309f3-4f79-46e2-a7c5-5d167b1d5a5f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:36.948746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-29b309f3-4f79-46e2-a7c5-5d167b1d5a5f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:36.999318 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ebe4044f-22db-42c8-b8ef-494ad9cd87ca tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Action: 'create', calling method: .version_select at 0x7f50408c7c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1130395365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2ntA/Tz23Xo5CGfpa1/D5k28qAuRdfbSRRDUUtPF09l+txfg7MIigDQl8Z7fPjEQTx1znB58TfAQExTPqyV2A0JcGti0s9HqXIQ7Scu3hAFANt+Kl7D7abi2xTeMN1tA=="}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:52:37.061278 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-ebe4044f-22db-42c8-b8ef-494ad9cd87ca tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Getting quotas for project 2b08d1c1dcf64187b53e4e3a76b6e346. Resources: {'key_pairs'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:52:37.092381 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-ebe4044f-22db-42c8-b8ef-494ad9cd87ca tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Getting quotas for user 297a016ff2944b33a06d5ce81735fb8d and project 2b08d1c1dcf64187b53e4e3a76b6e346. Resources: {'key_pairs'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:52:37.140525 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-29b309f3-4f79-46e2-a7c5-5d167b1d5a5f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:37.153151 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-29b309f3-4f79-46e2-a7c5-5d167b1d5a5f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1699 microversion: 2.1 time: 0.230756 Aug 29 21:52:37.153980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 115/230] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:36 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1699 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:37.177301 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a4c2d547-0bdb-4107-afcb-dce33fbfa5d7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:52:37.184944 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a4c2d547-0bdb-4107-afcb-dce33fbfa5d7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:37.185933 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a4c2d547-0bdb-4107-afcb-dce33fbfa5d7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:37.186593 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a4c2d547-0bdb-4107-afcb-dce33fbfa5d7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:37.216456 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a4c2d547-0bdb-4107-afcb-dce33fbfa5d7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Going to try to start instance {{(pid=127883) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 21:52:37.324539 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ebe4044f-22db-42c8-b8ef-494ad9cd87ca tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.758832 Aug 29 21:52:37.325238 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 116/231] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 21:52:36 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:52:37.330082 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-7a81f2a8-1124-4e7c-9dd0-3ff4fc48c7ed req-6d02c1eb-dabd-43c4-80da-6564d1c61b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e60ebcd-98c1-4442-9c72-f4d9760c8d6f", "name": "network-vif-plugged", "status": "completed", "tag": "b49d987f-0fff-47f7-acee-6d31bbdeab4b"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:52:37.342535 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-7a81f2a8-1124-4e7c-9dd0-3ff4fc48c7ed req-6d02c1eb-dabd-43c4-80da-6564d1c61b28 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:37.342921 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-7a81f2a8-1124-4e7c-9dd0-3ff4fc48c7ed req-6d02c1eb-dabd-43c4-80da-6564d1c61b28 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:37.343367 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-7a81f2a8-1124-4e7c-9dd0-3ff4fc48c7ed req-6d02c1eb-dabd-43c4-80da-6564d1c61b28 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:37.358256 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-7a81f2a8-1124-4e7c-9dd0-3ff4fc48c7ed req-6d02c1eb-dabd-43c4-80da-6564d1c61b28 service nova] Creating event network-vif-plugged:b49d987f-0fff-47f7-acee-6d31bbdeab4b for instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f on hv-cinder-85426 Aug 29 21:52:37.365102 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-7a81f2a8-1124-4e7c-9dd0-3ff4fc48c7ed req-6d02c1eb-dabd-43c4-80da-6564d1c61b28 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038443 Aug 29 21:52:37.366604 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 117/232] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:52:37.437156 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-117e35ed-ed34-446a-b464-8892e1a9fd69 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:37.439325 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-117e35ed-ed34-446a-b464-8892e1a9fd69 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:37.447395 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-117e35ed-ed34-446a-b464-8892e1a9fd69 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:37.448825 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-117e35ed-ed34-446a-b464-8892e1a9fd69 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:37.449413 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-117e35ed-ed34-446a-b464-8892e1a9fd69 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:37.451110 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-117e35ed-ed34-446a-b464-8892e1a9fd69 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:37.451575 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-117e35ed-ed34-446a-b464-8892e1a9fd69 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:37.452058 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-117e35ed-ed34-446a-b464-8892e1a9fd69 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:37.564448 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a4c2d547-0bdb-4107-afcb-dce33fbfa5d7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "POST /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/action" status: 202 len: 0 microversion: 2.1 time: 0.391537 Aug 29 21:52:37.569538 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 116/233] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 21:52:37 2022] POST /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:52:37.587147 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f603ab52-00ee-4733-9e4d-4c26fb8aed74 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:37.587902 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f603ab52-00ee-4733-9e4d-4c26fb8aed74 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:37.603996 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f603ab52-00ee-4733-9e4d-4c26fb8aed74 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:37.608783 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f603ab52-00ee-4733-9e4d-4c26fb8aed74 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:37.609313 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f603ab52-00ee-4733-9e4d-4c26fb8aed74 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:37.610922 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f603ab52-00ee-4733-9e4d-4c26fb8aed74 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:37.612009 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f603ab52-00ee-4733-9e4d-4c26fb8aed74 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:37.613235 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f603ab52-00ee-4733-9e4d-4c26fb8aed74 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:37.639074 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:37.641368 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-117e35ed-ed34-446a-b464-8892e1a9fd69 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:37.655835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-117e35ed-ed34-446a-b464-8892e1a9fd69 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:37.659803 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-117e35ed-ed34-446a-b464-8892e1a9fd69 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:37.661396 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-117e35ed-ed34-446a-b464-8892e1a9fd69 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1740 microversion: 2.20 time: 0.230286 Aug 29 21:52:37.662290 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 118/234] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:37 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:37.918702 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f603ab52-00ee-4733-9e4d-4c26fb8aed74 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:37.951243 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f603ab52-00ee-4733-9e4d-4c26fb8aed74 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1708 microversion: 2.1 time: 0.373287 Aug 29 21:52:37.952770 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 117/235] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:37 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1708 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:37.956207 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2ac8319c-9ab0-4565-aa6f-bb8014e7a04d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:37.957782 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2ac8319c-9ab0-4565-aa6f-bb8014e7a04d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:37.968792 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ac8319c-9ab0-4565-aa6f-bb8014e7a04d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:37.969682 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ac8319c-9ab0-4565-aa6f-bb8014e7a04d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:37.970427 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ac8319c-9ab0-4565-aa6f-bb8014e7a04d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:37.972023 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ac8319c-9ab0-4565-aa6f-bb8014e7a04d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:37.973784 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ac8319c-9ab0-4565-aa6f-bb8014e7a04d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:37.974525 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ac8319c-9ab0-4565-aa6f-bb8014e7a04d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:38.359264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2ac8319c-9ab0-4565-aa6f-bb8014e7a04d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:38.367684 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2ac8319c-9ab0-4565-aa6f-bb8014e7a04d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.420639 Aug 29 21:52:38.368277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 119/236] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:37 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:38.702554 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-3433f5cc-db74-42a2-84bf-668c84101007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:38.703984 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-3433f5cc-db74-42a2-84bf-668c84101007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:38.792520 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3433f5cc-db74-42a2-84bf-668c84101007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:38.796019 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3433f5cc-db74-42a2-84bf-668c84101007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:38.798168 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3433f5cc-db74-42a2-84bf-668c84101007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:38.805573 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3433f5cc-db74-42a2-84bf-668c84101007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:38.811606 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3433f5cc-db74-42a2-84bf-668c84101007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:38.819199 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3433f5cc-db74-42a2-84bf-668c84101007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:38.992355 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d6a3d825-2e88-407a-9e8f-2e1887a28e4a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:38.994450 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d6a3d825-2e88-407a-9e8f-2e1887a28e4a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:39.024281 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:39.045971 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d6a3d825-2e88-407a-9e8f-2e1887a28e4a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:39.048154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d6a3d825-2e88-407a-9e8f-2e1887a28e4a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:39.048504 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d6a3d825-2e88-407a-9e8f-2e1887a28e4a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:39.051134 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d6a3d825-2e88-407a-9e8f-2e1887a28e4a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:39.053334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d6a3d825-2e88-407a-9e8f-2e1887a28e4a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:39.055380 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d6a3d825-2e88-407a-9e8f-2e1887a28e4a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:39.264219 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-3433f5cc-db74-42a2-84bf-668c84101007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:39.276142 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-3433f5cc-db74-42a2-84bf-668c84101007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:39.280507 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-3433f5cc-db74-42a2-84bf-668c84101007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:39.283564 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-3433f5cc-db74-42a2-84bf-668c84101007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1740 microversion: 2.20 time: 0.593254 Aug 29 21:52:39.306305 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 118/237] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:38 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1740 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:39.392521 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-220a5672-407d-4dd7-93f3-b07cdfa20d23 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:39.393889 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-220a5672-407d-4dd7-93f3-b07cdfa20d23 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:39.416885 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-220a5672-407d-4dd7-93f3-b07cdfa20d23 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:39.418197 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-220a5672-407d-4dd7-93f3-b07cdfa20d23 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:39.418969 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-220a5672-407d-4dd7-93f3-b07cdfa20d23 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:39.419867 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-220a5672-407d-4dd7-93f3-b07cdfa20d23 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:39.421019 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-220a5672-407d-4dd7-93f3-b07cdfa20d23 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:39.423145 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-220a5672-407d-4dd7-93f3-b07cdfa20d23 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:39.500293 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d6a3d825-2e88-407a-9e8f-2e1887a28e4a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:39.569721 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d6a3d825-2e88-407a-9e8f-2e1887a28e4a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1708 microversion: 2.1 time: 0.592506 Aug 29 21:52:39.584512 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 120/238] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:38 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1708 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:39.832819 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-220a5672-407d-4dd7-93f3-b07cdfa20d23 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:39.848180 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-220a5672-407d-4dd7-93f3-b07cdfa20d23 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.460158 Aug 29 21:52:39.850498 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 119/239] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:39 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:52:40.319035 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-120a09b9-cf2f-4ce4-84e6-bfcfd4888ffa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:40.320431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-120a09b9-cf2f-4ce4-84e6-bfcfd4888ffa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:40.342252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-120a09b9-cf2f-4ce4-84e6-bfcfd4888ffa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:40.343979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-120a09b9-cf2f-4ce4-84e6-bfcfd4888ffa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:40.347151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-120a09b9-cf2f-4ce4-84e6-bfcfd4888ffa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:40.348198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-120a09b9-cf2f-4ce4-84e6-bfcfd4888ffa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:40.350009 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-120a09b9-cf2f-4ce4-84e6-bfcfd4888ffa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:40.352415 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-120a09b9-cf2f-4ce4-84e6-bfcfd4888ffa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:40.402651 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=100 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:40.591944 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-120a09b9-cf2f-4ce4-84e6-bfcfd4888ffa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:40.603332 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-120a09b9-cf2f-4ce4-84e6-bfcfd4888ffa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:40.603670 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-1b762670-38fc-4378-9a2c-b57d8f08092d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:40.603941 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-1b762670-38fc-4378-9a2c-b57d8f08092d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:40.605744 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-120a09b9-cf2f-4ce4-84e6-bfcfd4888ffa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:40.608016 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-120a09b9-cf2f-4ce4-84e6-bfcfd4888ffa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1740 microversion: 2.20 time: 0.298515 Aug 29 21:52:40.610197 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 121/240] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:40 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1740 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:40.615950 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1b762670-38fc-4378-9a2c-b57d8f08092d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:40.620678 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1b762670-38fc-4378-9a2c-b57d8f08092d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:40.621492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1b762670-38fc-4378-9a2c-b57d8f08092d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:40.622995 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1b762670-38fc-4378-9a2c-b57d8f08092d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:40.623634 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1b762670-38fc-4378-9a2c-b57d8f08092d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:40.624231 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1b762670-38fc-4378-9a2c-b57d8f08092d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:40.879969 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6bcc4b5d-1926-440b-a569-b13ba2602ccd tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:40.881773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-6bcc4b5d-1926-440b-a569-b13ba2602ccd tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:40.894577 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6bcc4b5d-1926-440b-a569-b13ba2602ccd tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:40.895898 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6bcc4b5d-1926-440b-a569-b13ba2602ccd tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:40.897583 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6bcc4b5d-1926-440b-a569-b13ba2602ccd tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:40.899639 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6bcc4b5d-1926-440b-a569-b13ba2602ccd tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:40.901017 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6bcc4b5d-1926-440b-a569-b13ba2602ccd tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:40.903587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6bcc4b5d-1926-440b-a569-b13ba2602ccd tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:40.944765 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-1b762670-38fc-4378-9a2c-b57d8f08092d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:41.029357 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-1b762670-38fc-4378-9a2c-b57d8f08092d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1708 microversion: 2.1 time: 0.425208 Aug 29 21:52:41.045825 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 120/241] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:40 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1708 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:41.435851 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-6bcc4b5d-1926-440b-a569-b13ba2602ccd tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:41.458662 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-6bcc4b5d-1926-440b-a569-b13ba2602ccd tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.586156 Aug 29 21:52:41.459262 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 122/242] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:40 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:41.639022 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-399fa821-2c3f-4912-940e-f052b24a4be2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:41.640111 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-399fa821-2c3f-4912-940e-f052b24a4be2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:41.648527 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-399fa821-2c3f-4912-940e-f052b24a4be2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:41.650112 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-399fa821-2c3f-4912-940e-f052b24a4be2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:41.650112 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-399fa821-2c3f-4912-940e-f052b24a4be2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:41.650922 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-399fa821-2c3f-4912-940e-f052b24a4be2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:41.651570 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-399fa821-2c3f-4912-940e-f052b24a4be2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:41.652152 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-399fa821-2c3f-4912-940e-f052b24a4be2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:41.867263 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-399fa821-2c3f-4912-940e-f052b24a4be2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:41.908112 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-399fa821-2c3f-4912-940e-f052b24a4be2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:41.922833 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-399fa821-2c3f-4912-940e-f052b24a4be2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:41.930295 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-399fa821-2c3f-4912-940e-f052b24a4be2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1740 microversion: 2.20 time: 0.289882 Aug 29 21:52:41.939812 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 121/243] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:41 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1740 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:42.055449 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-00f97844-20eb-440a-8931-e0fb29227e52 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:42.056393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-00f97844-20eb-440a-8931-e0fb29227e52 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:42.070630 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-00f97844-20eb-440a-8931-e0fb29227e52 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:42.071803 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-00f97844-20eb-440a-8931-e0fb29227e52 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:42.073226 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-00f97844-20eb-440a-8931-e0fb29227e52 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:42.076048 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-00f97844-20eb-440a-8931-e0fb29227e52 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:42.076738 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-00f97844-20eb-440a-8931-e0fb29227e52 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:42.078286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-00f97844-20eb-440a-8931-e0fb29227e52 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:42.496863 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-00f97844-20eb-440a-8931-e0fb29227e52 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:42.498239 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2312e801-115b-406a-aa4e-afacdad7ecb6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:42.498855 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2312e801-115b-406a-aa4e-afacdad7ecb6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:42.511953 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-00f97844-20eb-440a-8931-e0fb29227e52 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1712 microversion: 2.1 time: 0.460750 Aug 29 21:52:42.520055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 123/244] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:42 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1712 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:42.524293 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2312e801-115b-406a-aa4e-afacdad7ecb6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:42.524827 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2312e801-115b-406a-aa4e-afacdad7ecb6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:42.534980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2312e801-115b-406a-aa4e-afacdad7ecb6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:42.535953 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2312e801-115b-406a-aa4e-afacdad7ecb6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:42.536632 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2312e801-115b-406a-aa4e-afacdad7ecb6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:42.537223 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2312e801-115b-406a-aa4e-afacdad7ecb6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:42.969666 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9cbe8636-5c42-4f32-924e-f57d33a0b31f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:42.971683 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9cbe8636-5c42-4f32-924e-f57d33a0b31f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:43.015122 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9cbe8636-5c42-4f32-924e-f57d33a0b31f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:43.020578 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9cbe8636-5c42-4f32-924e-f57d33a0b31f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:43.022042 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9cbe8636-5c42-4f32-924e-f57d33a0b31f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:43.025831 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9cbe8636-5c42-4f32-924e-f57d33a0b31f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:43.028064 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9cbe8636-5c42-4f32-924e-f57d33a0b31f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:43.029607 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9cbe8636-5c42-4f32-924e-f57d33a0b31f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:43.034248 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2312e801-115b-406a-aa4e-afacdad7ecb6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:43.044667 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2312e801-115b-406a-aa4e-afacdad7ecb6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.550446 Aug 29 21:52:43.060094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 122/245] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:42 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:52:43.364506 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9cbe8636-5c42-4f32-924e-f57d33a0b31f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:43.398025 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9cbe8636-5c42-4f32-924e-f57d33a0b31f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:43.418885 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9cbe8636-5c42-4f32-924e-f57d33a0b31f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:43.425899 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9cbe8636-5c42-4f32-924e-f57d33a0b31f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1740 microversion: 2.20 time: 0.457346 Aug 29 21:52:43.427246 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 124/246] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:42 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1740 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:52:44.090223 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-953d553a-0bae-4d15-ac28-e5823e7bc71f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:44.091197 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-953d553a-0bae-4d15-ac28-e5823e7bc71f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:44.111605 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-953d553a-0bae-4d15-ac28-e5823e7bc71f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:44.113722 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-953d553a-0bae-4d15-ac28-e5823e7bc71f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:44.114407 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-953d553a-0bae-4d15-ac28-e5823e7bc71f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:44.115960 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-953d553a-0bae-4d15-ac28-e5823e7bc71f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:44.119169 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-953d553a-0bae-4d15-ac28-e5823e7bc71f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:44.119556 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-953d553a-0bae-4d15-ac28-e5823e7bc71f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:44.463594 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5bb92701-8c49-493b-906f-a7294c603cd3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:44.465044 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5bb92701-8c49-493b-906f-a7294c603cd3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:44.485474 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5bb92701-8c49-493b-906f-a7294c603cd3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:44.490554 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5bb92701-8c49-493b-906f-a7294c603cd3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:44.490554 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5bb92701-8c49-493b-906f-a7294c603cd3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:44.496672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-953d553a-0bae-4d15-ac28-e5823e7bc71f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:44.504149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5bb92701-8c49-493b-906f-a7294c603cd3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:44.505081 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5bb92701-8c49-493b-906f-a7294c603cd3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:44.512375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5bb92701-8c49-493b-906f-a7294c603cd3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:44.521759 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-953d553a-0bae-4d15-ac28-e5823e7bc71f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.443472 Aug 29 21:52:44.533334 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 123/247] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:44 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:44.736399 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5bb92701-8c49-493b-906f-a7294c603cd3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:44.746280 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5bb92701-8c49-493b-906f-a7294c603cd3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:44.748040 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5bb92701-8c49-493b-906f-a7294c603cd3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:44.749379 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5bb92701-8c49-493b-906f-a7294c603cd3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1740 microversion: 2.20 time: 0.289990 Aug 29 21:52:44.757722 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 125/248] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:44 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:45.549613 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b88d29f4-cc85-4e73-81f2-3804f20da9d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:45.550819 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b88d29f4-cc85-4e73-81f2-3804f20da9d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:45.572257 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b88d29f4-cc85-4e73-81f2-3804f20da9d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:45.575872 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b88d29f4-cc85-4e73-81f2-3804f20da9d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:45.576683 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b88d29f4-cc85-4e73-81f2-3804f20da9d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:45.579694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b88d29f4-cc85-4e73-81f2-3804f20da9d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:45.581454 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b88d29f4-cc85-4e73-81f2-3804f20da9d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:45.585820 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b88d29f4-cc85-4e73-81f2-3804f20da9d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:45.769189 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b88d29f4-cc85-4e73-81f2-3804f20da9d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:45.776756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2ea24fcf-ec78-4ae2-aef8-ba4a2ea8b7f5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:45.780653 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2ea24fcf-ec78-4ae2-aef8-ba4a2ea8b7f5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:45.785184 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b88d29f4-cc85-4e73-81f2-3804f20da9d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.239879 Aug 29 21:52:45.786741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ea24fcf-ec78-4ae2-aef8-ba4a2ea8b7f5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:45.787325 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ea24fcf-ec78-4ae2-aef8-ba4a2ea8b7f5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:45.787769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ea24fcf-ec78-4ae2-aef8-ba4a2ea8b7f5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:45.789276 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ea24fcf-ec78-4ae2-aef8-ba4a2ea8b7f5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:45.789733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ea24fcf-ec78-4ae2-aef8-ba4a2ea8b7f5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:45.790173 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2ea24fcf-ec78-4ae2-aef8-ba4a2ea8b7f5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:45.797470 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 124/249] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:45 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:46.001167 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2ea24fcf-ec78-4ae2-aef8-ba4a2ea8b7f5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:46.028282 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2ea24fcf-ec78-4ae2-aef8-ba4a2ea8b7f5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:46.032968 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2ea24fcf-ec78-4ae2-aef8-ba4a2ea8b7f5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:46.034561 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2ea24fcf-ec78-4ae2-aef8-ba4a2ea8b7f5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1740 microversion: 2.20 time: 0.263297 Aug 29 21:52:46.037655 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 126/250] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:45 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:52:46.812589 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-82a10510-1a56-4b18-be71-4d68f5d597bb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:46.814389 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-82a10510-1a56-4b18-be71-4d68f5d597bb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:46.827436 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-82a10510-1a56-4b18-be71-4d68f5d597bb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:46.829032 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-82a10510-1a56-4b18-be71-4d68f5d597bb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:46.830779 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-82a10510-1a56-4b18-be71-4d68f5d597bb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:46.833205 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-82a10510-1a56-4b18-be71-4d68f5d597bb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:46.833950 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-82a10510-1a56-4b18-be71-4d68f5d597bb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:46.834888 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-82a10510-1a56-4b18-be71-4d68f5d597bb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:47.010633 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-82a10510-1a56-4b18-be71-4d68f5d597bb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:47.019959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-82a10510-1a56-4b18-be71-4d68f5d597bb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.212756 Aug 29 21:52:47.020880 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 125/251] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:46 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:47.066940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b549db3e-0c4a-41dc-b4af-ee818fcaddfa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:47.067731 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b549db3e-0c4a-41dc-b4af-ee818fcaddfa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:47.074436 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b549db3e-0c4a-41dc-b4af-ee818fcaddfa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:47.074921 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b549db3e-0c4a-41dc-b4af-ee818fcaddfa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:47.075561 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b549db3e-0c4a-41dc-b4af-ee818fcaddfa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:47.076289 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b549db3e-0c4a-41dc-b4af-ee818fcaddfa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:47.076765 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b549db3e-0c4a-41dc-b4af-ee818fcaddfa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:47.077533 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b549db3e-0c4a-41dc-b4af-ee818fcaddfa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:47.121554 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=4 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:47.261692 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b549db3e-0c4a-41dc-b4af-ee818fcaddfa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:47.271231 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b549db3e-0c4a-41dc-b4af-ee818fcaddfa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:47.272861 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b549db3e-0c4a-41dc-b4af-ee818fcaddfa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:47.274135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b549db3e-0c4a-41dc-b4af-ee818fcaddfa tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1740 microversion: 2.20 time: 0.211314 Aug 29 21:52:47.274801 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 127/252] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:47 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:52:48.064889 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-32a8d12c-002e-4855-b27f-78e51a392642 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:48.065668 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-32a8d12c-002e-4855-b27f-78e51a392642 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:48.078094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-32a8d12c-002e-4855-b27f-78e51a392642 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:48.078620 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-32a8d12c-002e-4855-b27f-78e51a392642 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:48.081344 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-32a8d12c-002e-4855-b27f-78e51a392642 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:48.082094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-32a8d12c-002e-4855-b27f-78e51a392642 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:48.082570 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-32a8d12c-002e-4855-b27f-78e51a392642 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:48.083002 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-32a8d12c-002e-4855-b27f-78e51a392642 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:48.262473 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-32a8d12c-002e-4855-b27f-78e51a392642 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:48.271073 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-32a8d12c-002e-4855-b27f-78e51a392642 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.212465 Aug 29 21:52:48.285796 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 126/253] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:48 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:48.302941 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ebc7b8dd-b933-4357-a731-e83d9fa8530b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:48.303859 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ebc7b8dd-b933-4357-a731-e83d9fa8530b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:48.311738 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebc7b8dd-b933-4357-a731-e83d9fa8530b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:48.312320 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebc7b8dd-b933-4357-a731-e83d9fa8530b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:48.315045 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebc7b8dd-b933-4357-a731-e83d9fa8530b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:48.315045 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebc7b8dd-b933-4357-a731-e83d9fa8530b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:48.315337 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebc7b8dd-b933-4357-a731-e83d9fa8530b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:48.315767 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebc7b8dd-b933-4357-a731-e83d9fa8530b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:48.520255 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ebc7b8dd-b933-4357-a731-e83d9fa8530b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:48.530219 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ebc7b8dd-b933-4357-a731-e83d9fa8530b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:48.532297 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ebc7b8dd-b933-4357-a731-e83d9fa8530b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:48.533709 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ebc7b8dd-b933-4357-a731-e83d9fa8530b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1740 microversion: 2.20 time: 0.237666 Aug 29 21:52:48.534744 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 128/254] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:48 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:49.293396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0d96129b-b992-4876-b467-1bbf32648c42 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:49.294033 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0d96129b-b992-4876-b467-1bbf32648c42 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:49.309192 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0d96129b-b992-4876-b467-1bbf32648c42 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:49.309689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0d96129b-b992-4876-b467-1bbf32648c42 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:49.310125 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0d96129b-b992-4876-b467-1bbf32648c42 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:49.311031 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0d96129b-b992-4876-b467-1bbf32648c42 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:49.311658 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0d96129b-b992-4876-b467-1bbf32648c42 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:49.312088 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0d96129b-b992-4876-b467-1bbf32648c42 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:49.469892 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0d96129b-b992-4876-b467-1bbf32648c42 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:49.478946 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0d96129b-b992-4876-b467-1bbf32648c42 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.189817 Aug 29 21:52:49.499890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 127/255] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:49 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:49.568509 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-381c5c91-0b8a-4f9a-b510-3ba9aeed7f65 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:49.570847 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-381c5c91-0b8a-4f9a-b510-3ba9aeed7f65 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:49.582585 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-381c5c91-0b8a-4f9a-b510-3ba9aeed7f65 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:49.585734 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-381c5c91-0b8a-4f9a-b510-3ba9aeed7f65 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:49.585734 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-381c5c91-0b8a-4f9a-b510-3ba9aeed7f65 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:49.585734 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-381c5c91-0b8a-4f9a-b510-3ba9aeed7f65 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:49.585734 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-381c5c91-0b8a-4f9a-b510-3ba9aeed7f65 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:49.586193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-381c5c91-0b8a-4f9a-b510-3ba9aeed7f65 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:49.760549 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-381c5c91-0b8a-4f9a-b510-3ba9aeed7f65 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:49.773701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-381c5c91-0b8a-4f9a-b510-3ba9aeed7f65 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:49.778067 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-381c5c91-0b8a-4f9a-b510-3ba9aeed7f65 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:49.778067 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-381c5c91-0b8a-4f9a-b510-3ba9aeed7f65 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1740 microversion: 2.20 time: 0.215493 Aug 29 21:52:49.781081 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 129/256] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:49 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:50.501683 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-788e8ebb-03d8-4e6a-a85d-f7b8b7cc4a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:50.503039 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-788e8ebb-03d8-4e6a-a85d-f7b8b7cc4a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:50.510088 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-788e8ebb-03d8-4e6a-a85d-f7b8b7cc4a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:50.511374 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-788e8ebb-03d8-4e6a-a85d-f7b8b7cc4a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:50.511820 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-788e8ebb-03d8-4e6a-a85d-f7b8b7cc4a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:50.512616 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-788e8ebb-03d8-4e6a-a85d-f7b8b7cc4a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:50.513298 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-788e8ebb-03d8-4e6a-a85d-f7b8b7cc4a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:50.513948 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-788e8ebb-03d8-4e6a-a85d-f7b8b7cc4a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:50.696274 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-788e8ebb-03d8-4e6a-a85d-f7b8b7cc4a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:50.708803 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-788e8ebb-03d8-4e6a-a85d-f7b8b7cc4a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.211214 Aug 29 21:52:50.724257 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 128/257] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:50 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:50.801113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-15b0d549-445e-4a1a-863e-f28580b40917 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:50.801654 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-15b0d549-445e-4a1a-863e-f28580b40917 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:50.808770 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15b0d549-445e-4a1a-863e-f28580b40917 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:50.809264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15b0d549-445e-4a1a-863e-f28580b40917 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:50.809698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15b0d549-445e-4a1a-863e-f28580b40917 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:50.810414 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15b0d549-445e-4a1a-863e-f28580b40917 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:50.810852 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15b0d549-445e-4a1a-863e-f28580b40917 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:50.811472 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15b0d549-445e-4a1a-863e-f28580b40917 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:51.023266 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-15b0d549-445e-4a1a-863e-f28580b40917 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:51.034966 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-15b0d549-445e-4a1a-863e-f28580b40917 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:51.037502 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-15b0d549-445e-4a1a-863e-f28580b40917 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:51.039255 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-15b0d549-445e-4a1a-863e-f28580b40917 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1740 microversion: 2.20 time: 0.242140 Aug 29 21:52:51.040093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 130/258] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:50 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:51.734071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-87cfc233-d9e0-4bc6-a858-ebf2a5635aec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:51.735939 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-87cfc233-d9e0-4bc6-a858-ebf2a5635aec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:51.743129 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87cfc233-d9e0-4bc6-a858-ebf2a5635aec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:51.743971 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87cfc233-d9e0-4bc6-a858-ebf2a5635aec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:51.744950 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87cfc233-d9e0-4bc6-a858-ebf2a5635aec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:51.745747 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87cfc233-d9e0-4bc6-a858-ebf2a5635aec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:51.746473 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87cfc233-d9e0-4bc6-a858-ebf2a5635aec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:51.747012 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87cfc233-d9e0-4bc6-a858-ebf2a5635aec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:51.941079 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-87cfc233-d9e0-4bc6-a858-ebf2a5635aec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:51.949988 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-87cfc233-d9e0-4bc6-a858-ebf2a5635aec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.222117 Aug 29 21:52:51.951182 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 129/259] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:51 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:52.072375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b744b5d3-0920-4f67-bdaa-057a5e481001 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:52.073763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b744b5d3-0920-4f67-bdaa-057a5e481001 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:52.081546 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b744b5d3-0920-4f67-bdaa-057a5e481001 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:52.086579 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b744b5d3-0920-4f67-bdaa-057a5e481001 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:52.086579 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b744b5d3-0920-4f67-bdaa-057a5e481001 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:52.086579 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b744b5d3-0920-4f67-bdaa-057a5e481001 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:52.086579 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b744b5d3-0920-4f67-bdaa-057a5e481001 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:52.087158 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b744b5d3-0920-4f67-bdaa-057a5e481001 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:52.356674 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b744b5d3-0920-4f67-bdaa-057a5e481001 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:52.367133 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b744b5d3-0920-4f67-bdaa-057a5e481001 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:52.368871 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b744b5d3-0920-4f67-bdaa-057a5e481001 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:52.370757 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b744b5d3-0920-4f67-bdaa-057a5e481001 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1740 microversion: 2.20 time: 0.303331 Aug 29 21:52:52.371454 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 131/260] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:52 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:52.973194 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-55889c3e-c827-4c1f-95aa-55b3b3763b79 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:52.974014 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-55889c3e-c827-4c1f-95aa-55b3b3763b79 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:52.982182 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-55889c3e-c827-4c1f-95aa-55b3b3763b79 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:52.983089 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-55889c3e-c827-4c1f-95aa-55b3b3763b79 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:52.983256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-55889c3e-c827-4c1f-95aa-55b3b3763b79 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:52.984023 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-55889c3e-c827-4c1f-95aa-55b3b3763b79 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:52.984586 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-55889c3e-c827-4c1f-95aa-55b3b3763b79 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:52.985070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-55889c3e-c827-4c1f-95aa-55b3b3763b79 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:53.167026 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-55889c3e-c827-4c1f-95aa-55b3b3763b79 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:53.176239 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-55889c3e-c827-4c1f-95aa-55b3b3763b79 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.208144 Aug 29 21:52:53.176882 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 130/261] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:52 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:53.397163 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-04c5d075-1779-4e59-b853-a42aaa68c564 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:53.397827 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-04c5d075-1779-4e59-b853-a42aaa68c564 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:53.404847 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-04c5d075-1779-4e59-b853-a42aaa68c564 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:53.405570 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-04c5d075-1779-4e59-b853-a42aaa68c564 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:53.412995 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-04c5d075-1779-4e59-b853-a42aaa68c564 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:53.412995 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-04c5d075-1779-4e59-b853-a42aaa68c564 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:53.412995 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-04c5d075-1779-4e59-b853-a42aaa68c564 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:53.412995 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-04c5d075-1779-4e59-b853-a42aaa68c564 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:53.582450 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-04c5d075-1779-4e59-b853-a42aaa68c564 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:53.594602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-04c5d075-1779-4e59-b853-a42aaa68c564 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:53.596588 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-04c5d075-1779-4e59-b853-a42aaa68c564 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:53.597788 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-04c5d075-1779-4e59-b853-a42aaa68c564 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1740 microversion: 2.20 time: 0.204672 Aug 29 21:52:53.627768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 132/262] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:53 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:54.198242 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a3b86c8a-540e-4ef5-9ff4-0337e3055942 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:54.198873 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a3b86c8a-540e-4ef5-9ff4-0337e3055942 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:54.205480 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3b86c8a-540e-4ef5-9ff4-0337e3055942 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:54.205976 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3b86c8a-540e-4ef5-9ff4-0337e3055942 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:54.206422 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3b86c8a-540e-4ef5-9ff4-0337e3055942 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:54.207130 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3b86c8a-540e-4ef5-9ff4-0337e3055942 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:54.207591 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3b86c8a-540e-4ef5-9ff4-0337e3055942 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:54.208022 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3b86c8a-540e-4ef5-9ff4-0337e3055942 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:54.363496 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a3b86c8a-540e-4ef5-9ff4-0337e3055942 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:54.371972 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a3b86c8a-540e-4ef5-9ff4-0337e3055942 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.177573 Aug 29 21:52:54.372603 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 131/263] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:54 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:52:54.625898 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-096b6840-087c-4ac8-978f-9654903822d9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:54.626555 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-096b6840-087c-4ac8-978f-9654903822d9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:54.636312 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-096b6840-087c-4ac8-978f-9654903822d9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:54.637226 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-096b6840-087c-4ac8-978f-9654903822d9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:54.638025 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-096b6840-087c-4ac8-978f-9654903822d9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:54.639294 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-096b6840-087c-4ac8-978f-9654903822d9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:54.640130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-096b6840-087c-4ac8-978f-9654903822d9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:54.641013 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-096b6840-087c-4ac8-978f-9654903822d9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:54.790163 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-096b6840-087c-4ac8-978f-9654903822d9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:54.801843 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-096b6840-087c-4ac8-978f-9654903822d9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:54.803303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-096b6840-087c-4ac8-978f-9654903822d9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:54.804566 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-096b6840-087c-4ac8-978f-9654903822d9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1740 microversion: 2.20 time: 0.184675 Aug 29 21:52:54.805490 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 133/264] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:54 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:55.394822 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7aff17c3-4b41-43b6-a34d-b939735d3978 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:55.395664 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7aff17c3-4b41-43b6-a34d-b939735d3978 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:55.404440 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7aff17c3-4b41-43b6-a34d-b939735d3978 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:55.405343 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7aff17c3-4b41-43b6-a34d-b939735d3978 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:55.406118 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7aff17c3-4b41-43b6-a34d-b939735d3978 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:55.407493 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7aff17c3-4b41-43b6-a34d-b939735d3978 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:55.408583 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7aff17c3-4b41-43b6-a34d-b939735d3978 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:55.409278 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7aff17c3-4b41-43b6-a34d-b939735d3978 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:55.685420 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7aff17c3-4b41-43b6-a34d-b939735d3978 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:55.694550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7aff17c3-4b41-43b6-a34d-b939735d3978 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.303492 Aug 29 21:52:55.700200 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 132/265] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:55 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:55.827619 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4dbb9b4d-87ba-4be4-8712-5bfbbad87ecf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:55.828780 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4dbb9b4d-87ba-4be4-8712-5bfbbad87ecf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:55.835767 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4dbb9b4d-87ba-4be4-8712-5bfbbad87ecf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:55.836267 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4dbb9b4d-87ba-4be4-8712-5bfbbad87ecf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:55.836925 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4dbb9b4d-87ba-4be4-8712-5bfbbad87ecf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:55.837906 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4dbb9b4d-87ba-4be4-8712-5bfbbad87ecf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:55.838900 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4dbb9b4d-87ba-4be4-8712-5bfbbad87ecf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:55.839329 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4dbb9b4d-87ba-4be4-8712-5bfbbad87ecf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:56.015189 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4dbb9b4d-87ba-4be4-8712-5bfbbad87ecf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:56.025418 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4dbb9b4d-87ba-4be4-8712-5bfbbad87ecf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:56.027666 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4dbb9b4d-87ba-4be4-8712-5bfbbad87ecf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:56.028919 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4dbb9b4d-87ba-4be4-8712-5bfbbad87ecf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1722 microversion: 2.20 time: 0.205436 Aug 29 21:52:56.029491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 134/266] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:55 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:56.726478 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7bfd9c6d-c967-4a27-b970-cebe3bc4e67f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:56.728245 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7bfd9c6d-c967-4a27-b970-cebe3bc4e67f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:56.734995 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7bfd9c6d-c967-4a27-b970-cebe3bc4e67f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:56.735494 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7bfd9c6d-c967-4a27-b970-cebe3bc4e67f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:56.735955 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7bfd9c6d-c967-4a27-b970-cebe3bc4e67f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:56.736765 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7bfd9c6d-c967-4a27-b970-cebe3bc4e67f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:56.737416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7bfd9c6d-c967-4a27-b970-cebe3bc4e67f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:56.737844 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7bfd9c6d-c967-4a27-b970-cebe3bc4e67f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:56.911696 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7bfd9c6d-c967-4a27-b970-cebe3bc4e67f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:56.923534 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7bfd9c6d-c967-4a27-b970-cebe3bc4e67f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.200596 Aug 29 21:52:56.924971 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 133/267] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:56 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:57.059555 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c75ec7bf-3a72-427c-a6c2-e40dce8443f8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:57.060264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c75ec7bf-3a72-427c-a6c2-e40dce8443f8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:57.066469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c75ec7bf-3a72-427c-a6c2-e40dce8443f8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:57.069812 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c75ec7bf-3a72-427c-a6c2-e40dce8443f8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:57.069812 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c75ec7bf-3a72-427c-a6c2-e40dce8443f8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:57.069812 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c75ec7bf-3a72-427c-a6c2-e40dce8443f8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:57.069812 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c75ec7bf-3a72-427c-a6c2-e40dce8443f8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:57.070174 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c75ec7bf-3a72-427c-a6c2-e40dce8443f8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:57.227070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c75ec7bf-3a72-427c-a6c2-e40dce8443f8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:57.238947 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c75ec7bf-3a72-427c-a6c2-e40dce8443f8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:57.240905 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c75ec7bf-3a72-427c-a6c2-e40dce8443f8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:57.242645 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c75ec7bf-3a72-427c-a6c2-e40dce8443f8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1722 microversion: 2.20 time: 0.186949 Aug 29 21:52:57.243473 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 135/268] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:57 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:57.948932 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-5cfb1e7c-b241-4cf0-a5b3-af6d0d39fb0a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:57.949937 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-5cfb1e7c-b241-4cf0-a5b3-af6d0d39fb0a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:57.961500 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5cfb1e7c-b241-4cf0-a5b3-af6d0d39fb0a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:57.962260 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5cfb1e7c-b241-4cf0-a5b3-af6d0d39fb0a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:57.963844 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5cfb1e7c-b241-4cf0-a5b3-af6d0d39fb0a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:57.964931 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5cfb1e7c-b241-4cf0-a5b3-af6d0d39fb0a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:57.965630 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5cfb1e7c-b241-4cf0-a5b3-af6d0d39fb0a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:57.966307 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5cfb1e7c-b241-4cf0-a5b3-af6d0d39fb0a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:57.983642 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=100 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:58.162155 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-5cfb1e7c-b241-4cf0-a5b3-af6d0d39fb0a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:58.170701 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-5cfb1e7c-b241-4cf0-a5b3-af6d0d39fb0a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.227208 Aug 29 21:52:58.171876 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 134/269] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:57 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:58.279406 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ce1255a7-1249-4f0e-a262-de670edf5047 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:58.280168 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ce1255a7-1249-4f0e-a262-de670edf5047 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:58.286360 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce1255a7-1249-4f0e-a262-de670edf5047 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:58.286826 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce1255a7-1249-4f0e-a262-de670edf5047 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:58.287565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce1255a7-1249-4f0e-a262-de670edf5047 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:58.287943 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce1255a7-1249-4f0e-a262-de670edf5047 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:58.288400 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce1255a7-1249-4f0e-a262-de670edf5047 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:58.288839 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce1255a7-1249-4f0e-a262-de670edf5047 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:58.712270 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ce1255a7-1249-4f0e-a262-de670edf5047 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:58.722415 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ce1255a7-1249-4f0e-a262-de670edf5047 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:58.723950 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ce1255a7-1249-4f0e-a262-de670edf5047 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:58.725234 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ce1255a7-1249-4f0e-a262-de670edf5047 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1722 microversion: 2.20 time: 0.449800 Aug 29 21:52:58.725808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 136/270] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:58 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1722 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:52:59.194718 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-5b8c2418-06c1-4f39-b674-9e1919a9170c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:59.195256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-5b8c2418-06c1-4f39-b674-9e1919a9170c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:59.203559 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5b8c2418-06c1-4f39-b674-9e1919a9170c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:59.204261 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5b8c2418-06c1-4f39-b674-9e1919a9170c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:59.204807 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5b8c2418-06c1-4f39-b674-9e1919a9170c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:59.205842 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5b8c2418-06c1-4f39-b674-9e1919a9170c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:59.206493 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5b8c2418-06c1-4f39-b674-9e1919a9170c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:59.207074 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5b8c2418-06c1-4f39-b674-9e1919a9170c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:59.373020 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-5b8c2418-06c1-4f39-b674-9e1919a9170c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:59.380946 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-5b8c2418-06c1-4f39-b674-9e1919a9170c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.190644 Aug 29 21:52:59.381522 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 135/271] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:52:59 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:52:59.754676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-11a879b9-3440-4a11-be66-5441036f8ca9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:52:59.756208 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-11a879b9-3440-4a11-be66-5441036f8ca9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:52:59.763911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11a879b9-3440-4a11-be66-5441036f8ca9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:59.764440 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11a879b9-3440-4a11-be66-5441036f8ca9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:59.764946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11a879b9-3440-4a11-be66-5441036f8ca9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:59.765674 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11a879b9-3440-4a11-be66-5441036f8ca9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:52:59.766184 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11a879b9-3440-4a11-be66-5441036f8ca9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:52:59.766610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11a879b9-3440-4a11-be66-5441036f8ca9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:52:59.928151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-11a879b9-3440-4a11-be66-5441036f8ca9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:59.939588 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-11a879b9-3440-4a11-be66-5441036f8ca9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:59.941309 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-11a879b9-3440-4a11-be66-5441036f8ca9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:52:59.942566 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-11a879b9-3440-4a11-be66-5441036f8ca9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1722 microversion: 2.20 time: 0.192685 Aug 29 21:52:59.943152 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 137/272] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:52:59 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:53:00.405957 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-75ea7b1b-de9d-4355-a0ab-b54f5aa992f7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:00.407370 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-75ea7b1b-de9d-4355-a0ab-b54f5aa992f7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:00.421665 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-75ea7b1b-de9d-4355-a0ab-b54f5aa992f7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:00.422943 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-75ea7b1b-de9d-4355-a0ab-b54f5aa992f7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:00.428407 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-75ea7b1b-de9d-4355-a0ab-b54f5aa992f7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:00.428407 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-75ea7b1b-de9d-4355-a0ab-b54f5aa992f7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:00.428407 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-75ea7b1b-de9d-4355-a0ab-b54f5aa992f7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:00.428407 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-75ea7b1b-de9d-4355-a0ab-b54f5aa992f7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:00.973781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-03d7c81b-7bc4-47c8-9225-9eeeec78e637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:01.000976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-03d7c81b-7bc4-47c8-9225-9eeeec78e637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:01.024290 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-75ea7b1b-de9d-4355-a0ab-b54f5aa992f7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:01.037507 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-03d7c81b-7bc4-47c8-9225-9eeeec78e637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:01.039370 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-03d7c81b-7bc4-47c8-9225-9eeeec78e637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:01.040504 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-03d7c81b-7bc4-47c8-9225-9eeeec78e637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:01.044432 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-03d7c81b-7bc4-47c8-9225-9eeeec78e637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:01.045980 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-03d7c81b-7bc4-47c8-9225-9eeeec78e637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:01.046923 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-03d7c81b-7bc4-47c8-9225-9eeeec78e637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:01.065183 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-75ea7b1b-de9d-4355-a0ab-b54f5aa992f7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.652537 Aug 29 21:53:01.065183 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 136/273] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:00 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:01.065183 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-7d2490db-150a-4375-ac34-c157f84d26f3 req-01e25e1c-fa76-4cb1-8b2a-84904e1512c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e60ebcd-98c1-4442-9c72-f4d9760c8d6f", "name": "network-vif-unplugged", "status": "completed", "tag": "b49d987f-0fff-47f7-acee-6d31bbdeab4b"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:01.084802 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-7d2490db-150a-4375-ac34-c157f84d26f3 req-01e25e1c-fa76-4cb1-8b2a-84904e1512c6 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:01.086687 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-7d2490db-150a-4375-ac34-c157f84d26f3 req-01e25e1c-fa76-4cb1-8b2a-84904e1512c6 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:01.087706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-7d2490db-150a-4375-ac34-c157f84d26f3 req-01e25e1c-fa76-4cb1-8b2a-84904e1512c6 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:01.107470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=100 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:01.111856 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-7d2490db-150a-4375-ac34-c157f84d26f3 req-01e25e1c-fa76-4cb1-8b2a-84904e1512c6 service nova] Creating event network-vif-unplugged:b49d987f-0fff-47f7-acee-6d31bbdeab4b for instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f on hv-cinder-85426 Aug 29 21:53:01.123457 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-7d2490db-150a-4375-ac34-c157f84d26f3 req-01e25e1c-fa76-4cb1-8b2a-84904e1512c6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069462 Aug 29 21:53:01.129819 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 137/274] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:53:01.322793 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-03d7c81b-7bc4-47c8-9225-9eeeec78e637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:01.339235 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-03d7c81b-7bc4-47c8-9225-9eeeec78e637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:01.342743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-03d7c81b-7bc4-47c8-9225-9eeeec78e637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:01.345390 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-03d7c81b-7bc4-47c8-9225-9eeeec78e637 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1725 microversion: 2.20 time: 0.380791 Aug 29 21:53:01.346370 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 138/275] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:00 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1725 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:01.402810 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0209093c-802a-433f-bc72-ff75d79e8007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df927b91-3b11-455f-8536-10a7792d03ae"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:01.407954 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0209093c-802a-433f-bc72-ff75d79e8007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:01.438847 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0209093c-802a-433f-bc72-ff75d79e8007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:01.439359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0209093c-802a-433f-bc72-ff75d79e8007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:01.439830 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0209093c-802a-433f-bc72-ff75d79e8007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:01.440609 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0209093c-802a-433f-bc72-ff75d79e8007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:01.441207 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0209093c-802a-433f-bc72-ff75d79e8007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:01.442288 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0209093c-802a-433f-bc72-ff75d79e8007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:02.093295 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-12757fe0-2062-400c-a804-32043e1b9bf5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:02.094211 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-12757fe0-2062-400c-a804-32043e1b9bf5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:02.101458 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12757fe0-2062-400c-a804-32043e1b9bf5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:02.102156 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12757fe0-2062-400c-a804-32043e1b9bf5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:02.102865 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12757fe0-2062-400c-a804-32043e1b9bf5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:02.103873 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12757fe0-2062-400c-a804-32043e1b9bf5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:02.105313 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12757fe0-2062-400c-a804-32043e1b9bf5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:02.105837 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12757fe0-2062-400c-a804-32043e1b9bf5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:02.271137 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-12757fe0-2062-400c-a804-32043e1b9bf5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:02.279848 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-12757fe0-2062-400c-a804-32043e1b9bf5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1521 microversion: 2.1 time: 0.196689 Aug 29 21:53:02.280425 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 139/276] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:02 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:03.235954 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0209093c-802a-433f-bc72-ff75d79e8007 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "POST /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.842005 Aug 29 21:53:03.237292 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 138/277] 10.222.0.83 () {62 vars in 1364 bytes} [Mon Aug 29 21:53:01 2022] POST /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments => generated 188 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:53:03.303629 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-1f9f923e-4b8f-4cca-9aca-71c988a6334f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:03.304448 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-1f9f923e-4b8f-4cca-9aca-71c988a6334f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:03.330299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f9f923e-4b8f-4cca-9aca-71c988a6334f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:03.330299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f9f923e-4b8f-4cca-9aca-71c988a6334f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:03.330299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f9f923e-4b8f-4cca-9aca-71c988a6334f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:03.330299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f9f923e-4b8f-4cca-9aca-71c988a6334f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:03.335175 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f9f923e-4b8f-4cca-9aca-71c988a6334f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:03.335743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f9f923e-4b8f-4cca-9aca-71c988a6334f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:03.501745 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a59ff564-82c9-4edd-aa66-54f5f1e5f768 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:03.502752 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a59ff564-82c9-4edd-aa66-54f5f1e5f768 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:03.515780 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a59ff564-82c9-4edd-aa66-54f5f1e5f768 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:03.520300 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a59ff564-82c9-4edd-aa66-54f5f1e5f768 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:03.520300 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a59ff564-82c9-4edd-aa66-54f5f1e5f768 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:03.522137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a59ff564-82c9-4edd-aa66-54f5f1e5f768 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:03.523755 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a59ff564-82c9-4edd-aa66-54f5f1e5f768 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:03.525970 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a59ff564-82c9-4edd-aa66-54f5f1e5f768 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:03.630605 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a59ff564-82c9-4edd-aa66-54f5f1e5f768 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127883) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 21:53:03.833314 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1f9f923e-4b8f-4cca-9aca-71c988a6334f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:03.842591 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-1f9f923e-4b8f-4cca-9aca-71c988a6334f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1501 microversion: 2.1 time: 0.544154 Aug 29 21:53:03.843956 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 140/278] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:03 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1501 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:03.864179 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-bb18ff89-022f-4366-be32-1a0308374390 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:03.864887 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-bb18ff89-022f-4366-be32-1a0308374390 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:03.871863 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bb18ff89-022f-4366-be32-1a0308374390 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:03.873373 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bb18ff89-022f-4366-be32-1a0308374390 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:03.874218 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bb18ff89-022f-4366-be32-1a0308374390 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:03.875113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bb18ff89-022f-4366-be32-1a0308374390 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:03.875945 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bb18ff89-022f-4366-be32-1a0308374390 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:03.876720 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bb18ff89-022f-4366-be32-1a0308374390 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:04.078564 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a59ff564-82c9-4edd-aa66-54f5f1e5f768 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "POST /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/action" status: 202 len: 0 microversion: 2.20 time: 0.581675 Aug 29 21:53:04.082737 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 139/279] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 21:53:03 2022] POST /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:53:04.097034 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ed214396-e7de-42cc-b1b9-e400bfac80c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:04.098668 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ed214396-e7de-42cc-b1b9-e400bfac80c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:04.107360 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-bb18ff89-022f-4366-be32-1a0308374390 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:04.111991 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ed214396-e7de-42cc-b1b9-e400bfac80c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:04.112961 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ed214396-e7de-42cc-b1b9-e400bfac80c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:04.114380 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ed214396-e7de-42cc-b1b9-e400bfac80c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:04.116089 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ed214396-e7de-42cc-b1b9-e400bfac80c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:04.117363 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ed214396-e7de-42cc-b1b9-e400bfac80c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:04.118206 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-bb18ff89-022f-4366-be32-1a0308374390 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1515 microversion: 2.1 time: 0.257662 Aug 29 21:53:04.119215 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ed214396-e7de-42cc-b1b9-e400bfac80c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:04.136804 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 141/280] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:03 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:04.346561 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ed214396-e7de-42cc-b1b9-e400bfac80c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:04.356112 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ed214396-e7de-42cc-b1b9-e400bfac80c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:04.358114 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ed214396-e7de-42cc-b1b9-e400bfac80c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:04.359747 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ed214396-e7de-42cc-b1b9-e400bfac80c5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1751 microversion: 2.20 time: 0.271521 Aug 29 21:53:04.361104 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 140/281] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:04 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1751 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:53:05.397067 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-715a1b37-e495-443d-9ce1-b5d7461a97b1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:05.398336 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-715a1b37-e495-443d-9ce1-b5d7461a97b1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:05.422084 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-715a1b37-e495-443d-9ce1-b5d7461a97b1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:05.423992 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-715a1b37-e495-443d-9ce1-b5d7461a97b1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:05.425059 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-715a1b37-e495-443d-9ce1-b5d7461a97b1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:05.426501 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-715a1b37-e495-443d-9ce1-b5d7461a97b1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:05.427538 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-715a1b37-e495-443d-9ce1-b5d7461a97b1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:05.428913 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-715a1b37-e495-443d-9ce1-b5d7461a97b1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:05.714676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-715a1b37-e495-443d-9ce1-b5d7461a97b1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:05.734135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-715a1b37-e495-443d-9ce1-b5d7461a97b1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:05.737260 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-715a1b37-e495-443d-9ce1-b5d7461a97b1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:05.739539 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-715a1b37-e495-443d-9ce1-b5d7461a97b1 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1751 microversion: 2.20 time: 0.349905 Aug 29 21:53:05.740909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 142/282] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:05 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1751 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:06.139248 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-938250492", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "networks": [{"uuid": "2295dc3b-698f-457a-94ea-bdffc1ea0b7b"}]}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:06.218600 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.network.neutron [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] validate_networks() for [('2295dc3b-698f-457a-94ea-bdffc1ea0b7b', None, None, None, None, None)] {{(pid=127883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:53:06.767732 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f690d1ee-8380-41d9-b9fb-91a355034994 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:06.780259 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f690d1ee-8380-41d9-b9fb-91a355034994 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:06.796850 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f690d1ee-8380-41d9-b9fb-91a355034994 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:06.797351 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f690d1ee-8380-41d9-b9fb-91a355034994 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:06.809342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f690d1ee-8380-41d9-b9fb-91a355034994 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:06.811847 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f690d1ee-8380-41d9-b9fb-91a355034994 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:06.812585 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f690d1ee-8380-41d9-b9fb-91a355034994 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:06.820059 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f690d1ee-8380-41d9-b9fb-91a355034994 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:06.966945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Flavor limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:53:06.967501 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Image limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:53:06.968275 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Flavor pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:53:06.968800 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Image pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:53:06.969296 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:53:06.972404 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:06.987206 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:06.987851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:06.988464 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:06.989362 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:06.989932 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:06.990438 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:07.022384 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f690d1ee-8380-41d9-b9fb-91a355034994 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:07.029117 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Getting quotas for project 1515d87b44484ec4904ec2303c9f1f33. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:53:07.036153 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Getting quotas for user 9f617d6e3f3444cda7307794d7b8d837 and project 1515d87b44484ec4904ec2303c9f1f33. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:53:07.036298 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f690d1ee-8380-41d9-b9fb-91a355034994 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:07.039403 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f690d1ee-8380-41d9-b9fb-91a355034994 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:07.040756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f690d1ee-8380-41d9-b9fb-91a355034994 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1751 microversion: 2.20 time: 0.280851 Aug 29 21:53:07.048762 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 143/283] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:06 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1751 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:07.052254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Going to run 1 instances... {{(pid=127883) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:53:07.054711 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:53:07.270489 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-86c20a1b-f207-4c71-b506-1270018365e8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.135252 Aug 29 21:53:07.282951 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-7cd3bd62-0e0a-4f0f-a455-8a9003760aec tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:07.283571 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-7cd3bd62-0e0a-4f0f-a455-8a9003760aec tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:07.289614 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 141/284] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:53:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:53:07.341847 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-7cd3bd62-0e0a-4f0f-a455-8a9003760aec tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:07.360213 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-7cd3bd62-0e0a-4f0f-a455-8a9003760aec tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1218 microversion: 2.1 time: 0.081344 Aug 29 21:53:07.361274 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 144/285] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:07 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:07.385292 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b4124ffa-7919-402b-812b-aaa142f2dbc9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:07.388107 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b4124ffa-7919-402b-812b-aaa142f2dbc9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:07.395278 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b4124ffa-7919-402b-812b-aaa142f2dbc9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:07.395850 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b4124ffa-7919-402b-812b-aaa142f2dbc9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:07.396214 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b4124ffa-7919-402b-812b-aaa142f2dbc9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:07.396942 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b4124ffa-7919-402b-812b-aaa142f2dbc9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:07.397391 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b4124ffa-7919-402b-812b-aaa142f2dbc9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:07.397812 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b4124ffa-7919-402b-812b-aaa142f2dbc9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:07.436699 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-b4124ffa-7919-402b-812b-aaa142f2dbc9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lazy-loading 'flavor' on Instance uuid 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:53:07.802032 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b4124ffa-7919-402b-812b-aaa142f2dbc9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "POST /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8/action" status: 200 len: 32 microversion: 2.1 time: 0.420214 Aug 29 21:53:07.804128 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 142/286] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 21:53:07 2022] POST /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8/action => generated 32 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:53:07.815640 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-459ed0b1-d046-4e36-af5d-f67dac9c39a5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:07.816263 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-459ed0b1-d046-4e36-af5d-f67dac9c39a5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:07.824965 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-459ed0b1-d046-4e36-af5d-f67dac9c39a5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:07.825765 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-459ed0b1-d046-4e36-af5d-f67dac9c39a5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:07.826371 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-459ed0b1-d046-4e36-af5d-f67dac9c39a5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:07.827251 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-459ed0b1-d046-4e36-af5d-f67dac9c39a5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:07.827872 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-459ed0b1-d046-4e36-af5d-f67dac9c39a5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:07.828465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-459ed0b1-d046-4e36-af5d-f67dac9c39a5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:08.073789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-459ed0b1-d046-4e36-af5d-f67dac9c39a5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:08.077291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-fd46fd26-9595-4559-9c3e-88df64732901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:08.079550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-fd46fd26-9595-4559-9c3e-88df64732901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:08.079712 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-459ed0b1-d046-4e36-af5d-f67dac9c39a5 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.268565 Aug 29 21:53:08.086533 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 145/287] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:07 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:08.090853 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fd46fd26-9595-4559-9c3e-88df64732901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:08.091766 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fd46fd26-9595-4559-9c3e-88df64732901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:08.092358 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fd46fd26-9595-4559-9c3e-88df64732901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:08.094155 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fd46fd26-9595-4559-9c3e-88df64732901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:08.094771 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fd46fd26-9595-4559-9c3e-88df64732901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:08.095346 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fd46fd26-9595-4559-9c3e-88df64732901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:08.273690 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-fd46fd26-9595-4559-9c3e-88df64732901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:08.287830 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-fd46fd26-9595-4559-9c3e-88df64732901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:08.289404 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-fd46fd26-9595-4559-9c3e-88df64732901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:08.290630 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-fd46fd26-9595-4559-9c3e-88df64732901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1753 microversion: 2.20 time: 0.228525 Aug 29 21:53:08.291778 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 143/288] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:08 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1753 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:08.386467 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b89b8750-81f2-4b6d-a03d-400ae14b5cd8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:08.387535 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b89b8750-81f2-4b6d-a03d-400ae14b5cd8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:08.491297 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b89b8750-81f2-4b6d-a03d-400ae14b5cd8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:08.500353 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b89b8750-81f2-4b6d-a03d-400ae14b5cd8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1218 microversion: 2.1 time: 0.120557 Aug 29 21:53:08.505101 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 146/289] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:08 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:09.113545 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-78761fc6-4c03-42ae-98f6-7dc55a2c8b93 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:09.114215 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-78761fc6-4c03-42ae-98f6-7dc55a2c8b93 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:09.125378 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-78761fc6-4c03-42ae-98f6-7dc55a2c8b93 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:09.125378 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-78761fc6-4c03-42ae-98f6-7dc55a2c8b93 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:09.125378 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-78761fc6-4c03-42ae-98f6-7dc55a2c8b93 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:09.142117 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-78761fc6-4c03-42ae-98f6-7dc55a2c8b93 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:09.142842 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-78761fc6-4c03-42ae-98f6-7dc55a2c8b93 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:09.143434 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-78761fc6-4c03-42ae-98f6-7dc55a2c8b93 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:09.325519 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b5c1588c-58b0-4b67-9918-73c9eef322b9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:09.326733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b5c1588c-58b0-4b67-9918-73c9eef322b9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:09.336563 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5c1588c-58b0-4b67-9918-73c9eef322b9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:09.337298 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5c1588c-58b0-4b67-9918-73c9eef322b9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:09.338617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5c1588c-58b0-4b67-9918-73c9eef322b9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:09.340037 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5c1588c-58b0-4b67-9918-73c9eef322b9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:09.340718 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5c1588c-58b0-4b67-9918-73c9eef322b9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:09.341303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5c1588c-58b0-4b67-9918-73c9eef322b9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:09.357376 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-78761fc6-4c03-42ae-98f6-7dc55a2c8b93 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:09.370341 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-78761fc6-4c03-42ae-98f6-7dc55a2c8b93 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.261174 Aug 29 21:53:09.371172 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 144/290] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:09 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:09.528543 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f3c41f7e-d4ae-4284-b032-485e987d3701 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:09.529467 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f3c41f7e-d4ae-4284-b032-485e987d3701 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:09.538722 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f3c41f7e-d4ae-4284-b032-485e987d3701 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:09.538722 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f3c41f7e-d4ae-4284-b032-485e987d3701 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:09.538999 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f3c41f7e-d4ae-4284-b032-485e987d3701 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:09.539560 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f3c41f7e-d4ae-4284-b032-485e987d3701 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:09.540202 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f3c41f7e-d4ae-4284-b032-485e987d3701 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:09.540666 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f3c41f7e-d4ae-4284-b032-485e987d3701 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:09.542470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b5c1588c-58b0-4b67-9918-73c9eef322b9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:09.555539 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b5c1588c-58b0-4b67-9918-73c9eef322b9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:09.557237 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b5c1588c-58b0-4b67-9918-73c9eef322b9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:09.558668 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b5c1588c-58b0-4b67-9918-73c9eef322b9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1753 microversion: 2.20 time: 0.237638 Aug 29 21:53:09.562883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 147/291] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:09 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1753 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:09.641802 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f3c41f7e-d4ae-4284-b032-485e987d3701 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:09.651994 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f3c41f7e-d4ae-4284-b032-485e987d3701 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1222 microversion: 2.1 time: 0.129604 Aug 29 21:53:09.652708 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 145/292] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:09 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:10.407204 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-1c512355-732c-4ca6-9e23-bf109b1a0039 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:10.408262 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-1c512355-732c-4ca6-9e23-bf109b1a0039 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:10.414490 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1c512355-732c-4ca6-9e23-bf109b1a0039 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:10.414983 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1c512355-732c-4ca6-9e23-bf109b1a0039 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:10.415416 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1c512355-732c-4ca6-9e23-bf109b1a0039 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:10.416708 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1c512355-732c-4ca6-9e23-bf109b1a0039 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:10.417168 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1c512355-732c-4ca6-9e23-bf109b1a0039 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:10.417595 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1c512355-732c-4ca6-9e23-bf109b1a0039 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:10.558656 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1c512355-732c-4ca6-9e23-bf109b1a0039 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:10.569635 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-1c512355-732c-4ca6-9e23-bf109b1a0039 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.169808 Aug 29 21:53:10.570670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 148/293] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:10 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:10.589901 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-613a7cfd-7073-4445-8761-22aef4b879ed tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:10.590759 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-613a7cfd-7073-4445-8761-22aef4b879ed tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:10.598495 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-613a7cfd-7073-4445-8761-22aef4b879ed tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:10.599124 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-613a7cfd-7073-4445-8761-22aef4b879ed tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:10.599637 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-613a7cfd-7073-4445-8761-22aef4b879ed tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:10.600740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-613a7cfd-7073-4445-8761-22aef4b879ed tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:10.601409 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-613a7cfd-7073-4445-8761-22aef4b879ed tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:10.602114 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-613a7cfd-7073-4445-8761-22aef4b879ed tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:10.623601 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:10.677901 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9e0d75d7-1981-4091-9169-f7e6047d2fd8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:10.679008 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9e0d75d7-1981-4091-9169-f7e6047d2fd8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:10.686417 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9e0d75d7-1981-4091-9169-f7e6047d2fd8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:10.687003 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9e0d75d7-1981-4091-9169-f7e6047d2fd8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:10.687448 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9e0d75d7-1981-4091-9169-f7e6047d2fd8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:10.688150 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9e0d75d7-1981-4091-9169-f7e6047d2fd8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:10.688805 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9e0d75d7-1981-4091-9169-f7e6047d2fd8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:10.689391 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9e0d75d7-1981-4091-9169-f7e6047d2fd8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:10.809042 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-613a7cfd-7073-4445-8761-22aef4b879ed tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:10.819639 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9e0d75d7-1981-4091-9169-f7e6047d2fd8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:10.824851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-613a7cfd-7073-4445-8761-22aef4b879ed tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:10.826328 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-613a7cfd-7073-4445-8761-22aef4b879ed tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:10.827820 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-613a7cfd-7073-4445-8761-22aef4b879ed tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.242599 Aug 29 21:53:10.828734 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9e0d75d7-1981-4091-9169-f7e6047d2fd8 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1270 microversion: 2.1 time: 0.154735 Aug 29 21:53:10.828904 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 146/294] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:10 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:53:10.829301 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 149/295] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:10 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:11.467173 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-17762626", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:11.522073 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.network.neutron [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] validate_networks() for None {{(pid=127883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:53:11.595606 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2bd79767-8303-472e-802a-92905790676f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:11.596329 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2bd79767-8303-472e-802a-92905790676f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:11.605636 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2bd79767-8303-472e-802a-92905790676f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:11.606129 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2bd79767-8303-472e-802a-92905790676f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:11.606805 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2bd79767-8303-472e-802a-92905790676f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:11.607549 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2bd79767-8303-472e-802a-92905790676f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:11.608008 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2bd79767-8303-472e-802a-92905790676f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:11.608430 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2bd79767-8303-472e-802a-92905790676f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:11.908024 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Flavor limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:53:11.908728 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Image limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:53:11.909471 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Flavor pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:53:11.910056 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Image pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:53:11.910831 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:53:11.923134 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:11.923660 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:11.924144 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:11.925523 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:11.926198 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:11.927203 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:11.949383 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Getting quotas for project 35e48d292397480b9b3191e957308c89. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:53:11.956578 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Getting quotas for user 3f87b42c88954740914f36c5ea16368f and project 35e48d292397480b9b3191e957308c89. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:53:11.968426 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2bd79767-8303-472e-802a-92905790676f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:11.981138 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2bd79767-8303-472e-802a-92905790676f tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.391887 Aug 29 21:53:11.982356 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 150/296] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:11 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:11.988520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-705c9955-7861-4b01-9c9a-ce900ad6f5dd tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:11.989086 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-705c9955-7861-4b01-9c9a-ce900ad6f5dd tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:11.989863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Going to run 1 instances... {{(pid=127883) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:53:11.996180 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:53:11.997690 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-705c9955-7861-4b01-9c9a-ce900ad6f5dd tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:11.998341 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-705c9955-7861-4b01-9c9a-ce900ad6f5dd tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:11.998781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-705c9955-7861-4b01-9c9a-ce900ad6f5dd tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:11.999925 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-705c9955-7861-4b01-9c9a-ce900ad6f5dd tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:12.000401 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-705c9955-7861-4b01-9c9a-ce900ad6f5dd tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:12.000875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-705c9955-7861-4b01-9c9a-ce900ad6f5dd tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:12.084799 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-705c9955-7861-4b01-9c9a-ce900ad6f5dd tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:12.100391 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-705c9955-7861-4b01-9c9a-ce900ad6f5dd tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1288 microversion: 2.1 time: 0.116370 Aug 29 21:53:12.101962 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 151/297] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:11 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1288 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:12.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-78a2cd36-5564-49e2-8c6e-90d5c933d1b3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:12.133499 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-78a2cd36-5564-49e2-8c6e-90d5c933d1b3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:12.140419 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-78a2cd36-5564-49e2-8c6e-90d5c933d1b3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:12.141179 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-78a2cd36-5564-49e2-8c6e-90d5c933d1b3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:12.141808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-78a2cd36-5564-49e2-8c6e-90d5c933d1b3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:12.142712 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-78a2cd36-5564-49e2-8c6e-90d5c933d1b3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:12.143181 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-78a2cd36-5564-49e2-8c6e-90d5c933d1b3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:12.143608 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-78a2cd36-5564-49e2-8c6e-90d5c933d1b3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:12.164503 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-8a64b921-7ddb-4a6e-a384-db663fabeac0 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700999 Aug 29 21:53:12.166426 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 147/298] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:53:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:53:12.186423 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-49ebfaf2-c6a8-4ee0-8af7-c0b6eea4fefa tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:12.187052 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-49ebfaf2-c6a8-4ee0-8af7-c0b6eea4fefa tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:12.291089 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-49ebfaf2-c6a8-4ee0-8af7-c0b6eea4fefa tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:12.347037 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-49ebfaf2-c6a8-4ee0-8af7-c0b6eea4fefa tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1213 microversion: 2.1 time: 0.165064 Aug 29 21:53:12.353172 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 148/299] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:12 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1213 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:12.421924 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-78a2cd36-5564-49e2-8c6e-90d5c933d1b3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:12.433214 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-78a2cd36-5564-49e2-8c6e-90d5c933d1b3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:12.434776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-78a2cd36-5564-49e2-8c6e-90d5c933d1b3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:12.437710 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-78a2cd36-5564-49e2-8c6e-90d5c933d1b3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.323198 Aug 29 21:53:12.438327 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 152/300] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:12 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:13.014503 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b0f53fd0-387f-4095-9dd3-6251801111a0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:13.015138 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b0f53fd0-387f-4095-9dd3-6251801111a0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:13.028038 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b0f53fd0-387f-4095-9dd3-6251801111a0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:13.028845 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b0f53fd0-387f-4095-9dd3-6251801111a0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:13.032562 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b0f53fd0-387f-4095-9dd3-6251801111a0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:13.032562 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b0f53fd0-387f-4095-9dd3-6251801111a0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:13.032562 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b0f53fd0-387f-4095-9dd3-6251801111a0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:13.032562 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b0f53fd0-387f-4095-9dd3-6251801111a0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:13.152014 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c83a02ad-302d-4fdc-b8ff-9f9a85659703 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:13.152966 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c83a02ad-302d-4fdc-b8ff-9f9a85659703 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:13.158389 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=70 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:13.168872 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c83a02ad-302d-4fdc-b8ff-9f9a85659703 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:13.172262 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c83a02ad-302d-4fdc-b8ff-9f9a85659703 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:13.172953 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c83a02ad-302d-4fdc-b8ff-9f9a85659703 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:13.173792 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c83a02ad-302d-4fdc-b8ff-9f9a85659703 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:13.174334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c83a02ad-302d-4fdc-b8ff-9f9a85659703 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:13.176027 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c83a02ad-302d-4fdc-b8ff-9f9a85659703 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:13.280594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b0f53fd0-387f-4095-9dd3-6251801111a0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:13.294709 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b0f53fd0-387f-4095-9dd3-6251801111a0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.294352 Aug 29 21:53:13.295552 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 149/301] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:12 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:13.398233 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-44b6024e-1c20-43ba-b1fd-1e3d28aa4324 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:13.399162 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-44b6024e-1c20-43ba-b1fd-1e3d28aa4324 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:13.485261 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-44b6024e-1c20-43ba-b1fd-1e3d28aa4324 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:13.500194 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-44b6024e-1c20-43ba-b1fd-1e3d28aa4324 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1213 microversion: 2.1 time: 0.105647 Aug 29 21:53:13.507122 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 150/302] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:13 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:13.522455 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-826db680-783e-4145-bfd6-adb12d0d8f6a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:13.523095 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-826db680-783e-4145-bfd6-adb12d0d8f6a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:13.542644 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-826db680-783e-4145-bfd6-adb12d0d8f6a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:13.543130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c83a02ad-302d-4fdc-b8ff-9f9a85659703 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:13.543707 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-826db680-783e-4145-bfd6-adb12d0d8f6a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:13.544388 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-826db680-783e-4145-bfd6-adb12d0d8f6a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:13.545648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-826db680-783e-4145-bfd6-adb12d0d8f6a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:13.546353 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-826db680-783e-4145-bfd6-adb12d0d8f6a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:13.547120 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-826db680-783e-4145-bfd6-adb12d0d8f6a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:13.570433 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c83a02ad-302d-4fdc-b8ff-9f9a85659703 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.428575 Aug 29 21:53:13.589365 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 153/303] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:13 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:13.805429 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-826db680-783e-4145-bfd6-adb12d0d8f6a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:13.818249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-826db680-783e-4145-bfd6-adb12d0d8f6a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:13.820495 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-826db680-783e-4145-bfd6-adb12d0d8f6a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:13.822595 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-826db680-783e-4145-bfd6-adb12d0d8f6a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.313644 Aug 29 21:53:13.824096 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 151/304] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:13 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:14.328510 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-8769ad99-1990-4c2b-a58a-4418a3689f84 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:14.329247 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-8769ad99-1990-4c2b-a58a-4418a3689f84 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:14.340000 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8769ad99-1990-4c2b-a58a-4418a3689f84 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:14.340523 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8769ad99-1990-4c2b-a58a-4418a3689f84 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:14.342623 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8769ad99-1990-4c2b-a58a-4418a3689f84 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:14.342623 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8769ad99-1990-4c2b-a58a-4418a3689f84 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:14.342623 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8769ad99-1990-4c2b-a58a-4418a3689f84 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:14.342623 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8769ad99-1990-4c2b-a58a-4418a3689f84 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:14.521536 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-184ccedb-cb9e-4e3b-83c5-96142924b38c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:14.522902 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-184ccedb-cb9e-4e3b-83c5-96142924b38c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:14.539014 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-184ccedb-cb9e-4e3b-83c5-96142924b38c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:14.539931 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-184ccedb-cb9e-4e3b-83c5-96142924b38c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:14.540655 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-184ccedb-cb9e-4e3b-83c5-96142924b38c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:14.542185 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-184ccedb-cb9e-4e3b-83c5-96142924b38c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:14.542879 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-184ccedb-cb9e-4e3b-83c5-96142924b38c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:14.543487 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-184ccedb-cb9e-4e3b-83c5-96142924b38c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:14.650628 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-184ccedb-cb9e-4e3b-83c5-96142924b38c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:14.673562 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-184ccedb-cb9e-4e3b-83c5-96142924b38c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1217 microversion: 2.1 time: 0.154960 Aug 29 21:53:14.684966 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 152/305] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:14 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:14.684966 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-1518227c-6580-4210-ae46-b52daa7f5139 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:14.684966 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-1518227c-6580-4210-ae46-b52daa7f5139 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:14.706108 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1518227c-6580-4210-ae46-b52daa7f5139 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:14.706898 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1518227c-6580-4210-ae46-b52daa7f5139 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:14.707397 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1518227c-6580-4210-ae46-b52daa7f5139 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:14.708269 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1518227c-6580-4210-ae46-b52daa7f5139 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:14.714790 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1518227c-6580-4210-ae46-b52daa7f5139 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:14.715445 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1518227c-6580-4210-ae46-b52daa7f5139 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:14.724466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-8769ad99-1990-4c2b-a58a-4418a3689f84 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:14.735286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-8769ad99-1990-4c2b-a58a-4418a3689f84 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.410265 Aug 29 21:53:14.738247 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 154/306] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:14 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:14.847973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c5475cff-dd16-4c65-862a-d345a0f96bac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:14.851380 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c5475cff-dd16-4c65-862a-d345a0f96bac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:14.868103 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c5475cff-dd16-4c65-862a-d345a0f96bac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:14.902550 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c5475cff-dd16-4c65-862a-d345a0f96bac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:14.902550 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c5475cff-dd16-4c65-862a-d345a0f96bac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:14.902550 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c5475cff-dd16-4c65-862a-d345a0f96bac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:14.902550 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c5475cff-dd16-4c65-862a-d345a0f96bac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:14.904701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c5475cff-dd16-4c65-862a-d345a0f96bac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:15.110854 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c5475cff-dd16-4c65-862a-d345a0f96bac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:15.124098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-1518227c-6580-4210-ae46-b52daa7f5139 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:15.137321 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-1518227c-6580-4210-ae46-b52daa7f5139 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.460840 Aug 29 21:53:15.138321 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 153/307] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:14 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:15.141391 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c5475cff-dd16-4c65-862a-d345a0f96bac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:15.143759 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c5475cff-dd16-4c65-862a-d345a0f96bac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:15.145546 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c5475cff-dd16-4c65-862a-d345a0f96bac tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.302176 Aug 29 21:53:15.161099 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 155/308] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:14 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:53:15.503688 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-ead99c0b-4333-4659-b802-6ef183615394 req-ad8da591-22fb-485b-b42a-abc6c3f289df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f59fdcb-151b-40d2-befd-7114b5ac5c89", "tag": "932e39ce-a89d-40b4-8bde-ff728cdabf30"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:15.523631 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-ead99c0b-4333-4659-b802-6ef183615394 req-ad8da591-22fb-485b-b42a-abc6c3f289df service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:15.534498 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-ead99c0b-4333-4659-b802-6ef183615394 req-ad8da591-22fb-485b-b42a-abc6c3f289df service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:15.535215 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-ead99c0b-4333-4659-b802-6ef183615394 req-ad8da591-22fb-485b-b42a-abc6c3f289df service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:15.563751 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-ead99c0b-4333-4659-b802-6ef183615394 req-ad8da591-22fb-485b-b42a-abc6c3f289df service nova] Creating event network-changed:932e39ce-a89d-40b4-8bde-ff728cdabf30 for instance 3f59fdcb-151b-40d2-befd-7114b5ac5c89 on hv-cinder-85426 Aug 29 21:53:15.570451 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-ead99c0b-4333-4659-b802-6ef183615394 req-ad8da591-22fb-485b-b42a-abc6c3f289df service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070323 Aug 29 21:53:15.571198 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 154/309] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:53:15.701354 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-07b5f92f-2400-4e0a-a804-fc8e051996d2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:15.702864 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-07b5f92f-2400-4e0a-a804-fc8e051996d2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:15.717436 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-07b5f92f-2400-4e0a-a804-fc8e051996d2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:15.718554 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-07b5f92f-2400-4e0a-a804-fc8e051996d2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:15.719334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-07b5f92f-2400-4e0a-a804-fc8e051996d2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:15.720983 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-07b5f92f-2400-4e0a-a804-fc8e051996d2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:15.721503 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-07b5f92f-2400-4e0a-a804-fc8e051996d2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:15.722132 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-07b5f92f-2400-4e0a-a804-fc8e051996d2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:15.773425 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-bbd72aa9-47f0-485c-a88a-fb0834cd7945 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:15.774256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-bbd72aa9-47f0-485c-a88a-fb0834cd7945 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:15.782056 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bbd72aa9-47f0-485c-a88a-fb0834cd7945 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:15.782673 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bbd72aa9-47f0-485c-a88a-fb0834cd7945 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:15.783125 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bbd72aa9-47f0-485c-a88a-fb0834cd7945 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:15.783862 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bbd72aa9-47f0-485c-a88a-fb0834cd7945 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:15.784323 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bbd72aa9-47f0-485c-a88a-fb0834cd7945 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:15.784819 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bbd72aa9-47f0-485c-a88a-fb0834cd7945 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:15.811646 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-07b5f92f-2400-4e0a-a804-fc8e051996d2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:15.816318 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=100 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:15.822995 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-07b5f92f-2400-4e0a-a804-fc8e051996d2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1217 microversion: 2.1 time: 0.129523 Aug 29 21:53:15.823673 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 156/310] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:15 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:15.962212 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-bbd72aa9-47f0-485c-a88a-fb0834cd7945 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:15.974426 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-bbd72aa9-47f0-485c-a88a-fb0834cd7945 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.210619 Aug 29 21:53:15.976897 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 155/311] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:15 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:16.159215 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ad673cf6-ce4e-4f48-8725-de231638d3b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:16.159916 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ad673cf6-ce4e-4f48-8725-de231638d3b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:16.168809 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ad673cf6-ce4e-4f48-8725-de231638d3b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:16.169541 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ad673cf6-ce4e-4f48-8725-de231638d3b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:16.170010 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-80ae5785-5e96-460b-b8dc-c6a619d03a42 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:16.170563 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ad673cf6-ce4e-4f48-8725-de231638d3b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:16.170889 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-80ae5785-5e96-460b-b8dc-c6a619d03a42 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:16.171566 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ad673cf6-ce4e-4f48-8725-de231638d3b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:16.172208 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ad673cf6-ce4e-4f48-8725-de231638d3b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:16.172828 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ad673cf6-ce4e-4f48-8725-de231638d3b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:16.182603 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ae5785-5e96-460b-b8dc-c6a619d03a42 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:16.182603 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ae5785-5e96-460b-b8dc-c6a619d03a42 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:16.182603 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ae5785-5e96-460b-b8dc-c6a619d03a42 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:16.182603 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ae5785-5e96-460b-b8dc-c6a619d03a42 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:16.183252 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ae5785-5e96-460b-b8dc-c6a619d03a42 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:16.183479 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ae5785-5e96-460b-b8dc-c6a619d03a42 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:16.346550 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ad673cf6-ce4e-4f48-8725-de231638d3b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:16.365160 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ad673cf6-ce4e-4f48-8725-de231638d3b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.209625 Aug 29 21:53:16.366162 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 157/312] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:16 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:16.463719 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-80ae5785-5e96-460b-b8dc-c6a619d03a42 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:16.478079 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-80ae5785-5e96-460b-b8dc-c6a619d03a42 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:16.479842 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-80ae5785-5e96-460b-b8dc-c6a619d03a42 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:16.483209 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-80ae5785-5e96-460b-b8dc-c6a619d03a42 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.316802 Aug 29 21:53:16.490417 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 156/313] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:16 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:53:16.846342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-85cd4027-08a4-4a2a-a5e8-934c98332a85 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:16.848069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-85cd4027-08a4-4a2a-a5e8-934c98332a85 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:16.857982 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-85cd4027-08a4-4a2a-a5e8-934c98332a85 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:16.858736 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-85cd4027-08a4-4a2a-a5e8-934c98332a85 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:16.859321 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-85cd4027-08a4-4a2a-a5e8-934c98332a85 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:16.860120 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-85cd4027-08a4-4a2a-a5e8-934c98332a85 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:16.860642 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-85cd4027-08a4-4a2a-a5e8-934c98332a85 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:16.861161 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-85cd4027-08a4-4a2a-a5e8-934c98332a85 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:16.946417 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-85cd4027-08a4-4a2a-a5e8-934c98332a85 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:16.955652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-85cd4027-08a4-4a2a-a5e8-934c98332a85 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1217 microversion: 2.1 time: 0.114621 Aug 29 21:53:16.967549 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 158/314] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:16 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:16.998965 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-13726c85-6903-4642-a6a2-7ed9c1443835 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:17.008271 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-13726c85-6903-4642-a6a2-7ed9c1443835 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:17.016096 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-13726c85-6903-4642-a6a2-7ed9c1443835 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:17.016667 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-13726c85-6903-4642-a6a2-7ed9c1443835 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:17.017116 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-13726c85-6903-4642-a6a2-7ed9c1443835 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:17.017828 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-13726c85-6903-4642-a6a2-7ed9c1443835 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:17.018291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-13726c85-6903-4642-a6a2-7ed9c1443835 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:17.018755 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-13726c85-6903-4642-a6a2-7ed9c1443835 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:17.184589 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-13726c85-6903-4642-a6a2-7ed9c1443835 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:17.214101 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-13726c85-6903-4642-a6a2-7ed9c1443835 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.212969 Aug 29 21:53:17.214101 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 157/315] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:16 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:17.387905 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9bdcbb75-1d5e-42ea-bfd2-116fc9da55f2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:17.388581 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9bdcbb75-1d5e-42ea-bfd2-116fc9da55f2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:17.395207 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9bdcbb75-1d5e-42ea-bfd2-116fc9da55f2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:17.400898 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9bdcbb75-1d5e-42ea-bfd2-116fc9da55f2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:17.400898 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9bdcbb75-1d5e-42ea-bfd2-116fc9da55f2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:17.400898 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9bdcbb75-1d5e-42ea-bfd2-116fc9da55f2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:17.400898 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9bdcbb75-1d5e-42ea-bfd2-116fc9da55f2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:17.401324 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9bdcbb75-1d5e-42ea-bfd2-116fc9da55f2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:17.521318 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-88a75d52-04bf-4325-b62c-1369f10e6d90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:17.522075 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-88a75d52-04bf-4325-b62c-1369f10e6d90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:17.539216 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-88a75d52-04bf-4325-b62c-1369f10e6d90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:17.539751 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-88a75d52-04bf-4325-b62c-1369f10e6d90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:17.543424 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-88a75d52-04bf-4325-b62c-1369f10e6d90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:17.545415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-88a75d52-04bf-4325-b62c-1369f10e6d90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:17.545415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-88a75d52-04bf-4325-b62c-1369f10e6d90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:17.545699 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-88a75d52-04bf-4325-b62c-1369f10e6d90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:17.645841 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9bdcbb75-1d5e-42ea-bfd2-116fc9da55f2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:17.661795 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9bdcbb75-1d5e-42ea-bfd2-116fc9da55f2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.278435 Aug 29 21:53:17.688247 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 159/316] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:17 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:17.846610 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-88a75d52-04bf-4325-b62c-1369f10e6d90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:17.857469 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-88a75d52-04bf-4325-b62c-1369f10e6d90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:17.859509 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-88a75d52-04bf-4325-b62c-1369f10e6d90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:17.860968 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-88a75d52-04bf-4325-b62c-1369f10e6d90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.355468 Aug 29 21:53:17.876775 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 158/317] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:17 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:53:17.979342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ebc48b55-5912-42be-a527-fcb02ffa08ff tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:17.979984 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ebc48b55-5912-42be-a527-fcb02ffa08ff tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:17.986599 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebc48b55-5912-42be-a527-fcb02ffa08ff tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:17.987205 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebc48b55-5912-42be-a527-fcb02ffa08ff tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:17.987850 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebc48b55-5912-42be-a527-fcb02ffa08ff tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:17.988590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebc48b55-5912-42be-a527-fcb02ffa08ff tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:17.989091 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebc48b55-5912-42be-a527-fcb02ffa08ff tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:17.989518 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebc48b55-5912-42be-a527-fcb02ffa08ff tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:18.082965 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ebc48b55-5912-42be-a527-fcb02ffa08ff tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:18.088221 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ebc48b55-5912-42be-a527-fcb02ffa08ff tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1217 microversion: 2.1 time: 0.113235 Aug 29 21:53:18.088953 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 160/318] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:17 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:18.239322 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a8656a03-9afa-412d-bdfc-3106a02858e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:18.239938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a8656a03-9afa-412d-bdfc-3106a02858e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:18.247688 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a8656a03-9afa-412d-bdfc-3106a02858e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:18.248719 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a8656a03-9afa-412d-bdfc-3106a02858e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:18.249163 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a8656a03-9afa-412d-bdfc-3106a02858e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:18.249890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a8656a03-9afa-412d-bdfc-3106a02858e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:18.250351 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a8656a03-9afa-412d-bdfc-3106a02858e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:18.250805 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a8656a03-9afa-412d-bdfc-3106a02858e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:18.399925 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a8656a03-9afa-412d-bdfc-3106a02858e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:18.410226 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a8656a03-9afa-412d-bdfc-3106a02858e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.174668 Aug 29 21:53:18.424707 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 159/319] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:18 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:18.685175 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c73daca7-152b-4846-8fec-c3fbcd224521 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:18.685971 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c73daca7-152b-4846-8fec-c3fbcd224521 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:18.689496 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=4 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:18.693948 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c73daca7-152b-4846-8fec-c3fbcd224521 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:18.694797 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c73daca7-152b-4846-8fec-c3fbcd224521 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:18.695326 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c73daca7-152b-4846-8fec-c3fbcd224521 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:18.696209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c73daca7-152b-4846-8fec-c3fbcd224521 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:18.696793 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c73daca7-152b-4846-8fec-c3fbcd224521 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:18.697857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c73daca7-152b-4846-8fec-c3fbcd224521 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:18.871657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c73daca7-152b-4846-8fec-c3fbcd224521 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:18.889568 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c73daca7-152b-4846-8fec-c3fbcd224521 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.208539 Aug 29 21:53:18.891029 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 161/320] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:18 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:18.892383 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-c25d853f-2841-4f36-9f4b-aa4a3f35a697 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:18.893721 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-c25d853f-2841-4f36-9f4b-aa4a3f35a697 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:18.903398 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c25d853f-2841-4f36-9f4b-aa4a3f35a697 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:18.903890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c25d853f-2841-4f36-9f4b-aa4a3f35a697 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:18.904332 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c25d853f-2841-4f36-9f4b-aa4a3f35a697 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:18.905080 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c25d853f-2841-4f36-9f4b-aa4a3f35a697 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:18.905542 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c25d853f-2841-4f36-9f4b-aa4a3f35a697 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:18.905983 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c25d853f-2841-4f36-9f4b-aa4a3f35a697 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:19.111011 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c01772a0-bdfb-42e4-94ec-7d82af0ab4ae tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:19.111625 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c01772a0-bdfb-42e4-94ec-7d82af0ab4ae tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:19.118761 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c01772a0-bdfb-42e4-94ec-7d82af0ab4ae tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:19.119828 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c01772a0-bdfb-42e4-94ec-7d82af0ab4ae tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:19.120465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c01772a0-bdfb-42e4-94ec-7d82af0ab4ae tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:19.120722 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-c25d853f-2841-4f36-9f4b-aa4a3f35a697 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:19.121269 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c01772a0-bdfb-42e4-94ec-7d82af0ab4ae tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:19.121737 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c01772a0-bdfb-42e4-94ec-7d82af0ab4ae tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:19.122168 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c01772a0-bdfb-42e4-94ec-7d82af0ab4ae tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:19.132359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-c25d853f-2841-4f36-9f4b-aa4a3f35a697 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:19.135762 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-c25d853f-2841-4f36-9f4b-aa4a3f35a697 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:19.137016 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-c25d853f-2841-4f36-9f4b-aa4a3f35a697 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.249926 Aug 29 21:53:19.138237 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 160/321] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:18 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:19.208912 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c01772a0-bdfb-42e4-94ec-7d82af0ab4ae tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:19.217645 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c01772a0-bdfb-42e4-94ec-7d82af0ab4ae tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1217 microversion: 2.1 time: 0.110410 Aug 29 21:53:19.218285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 162/322] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:19 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:19.433507 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4c33f1b3-f963-4bbc-afe6-e265a91bac25 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:19.434862 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4c33f1b3-f963-4bbc-afe6-e265a91bac25 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:19.443939 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4c33f1b3-f963-4bbc-afe6-e265a91bac25 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:19.444764 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4c33f1b3-f963-4bbc-afe6-e265a91bac25 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:19.445697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4c33f1b3-f963-4bbc-afe6-e265a91bac25 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:19.446852 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4c33f1b3-f963-4bbc-afe6-e265a91bac25 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:19.448333 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4c33f1b3-f963-4bbc-afe6-e265a91bac25 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:19.448934 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4c33f1b3-f963-4bbc-afe6-e265a91bac25 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:19.620512 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4c33f1b3-f963-4bbc-afe6-e265a91bac25 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:19.633062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4c33f1b3-f963-4bbc-afe6-e265a91bac25 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.205192 Aug 29 21:53:19.636393 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 161/323] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:19 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:19.911723 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-37a57fe2-309f-47d5-9541-72398e490c12 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:19.912664 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-37a57fe2-309f-47d5-9541-72398e490c12 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:19.919967 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-37a57fe2-309f-47d5-9541-72398e490c12 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:19.920734 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-37a57fe2-309f-47d5-9541-72398e490c12 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:19.921495 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-37a57fe2-309f-47d5-9541-72398e490c12 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:19.925476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-37a57fe2-309f-47d5-9541-72398e490c12 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:19.926149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-37a57fe2-309f-47d5-9541-72398e490c12 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:19.926578 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-37a57fe2-309f-47d5-9541-72398e490c12 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:20.138685 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-37a57fe2-309f-47d5-9541-72398e490c12 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:20.148202 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-37a57fe2-309f-47d5-9541-72398e490c12 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.240520 Aug 29 21:53:20.148826 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 163/324] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:19 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:20.167175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-c3ec4193-406c-48fd-8c02-1da065ff7e50 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:20.168565 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-c3ec4193-406c-48fd-8c02-1da065ff7e50 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:20.177545 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c3ec4193-406c-48fd-8c02-1da065ff7e50 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:20.179843 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c3ec4193-406c-48fd-8c02-1da065ff7e50 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:20.180446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c3ec4193-406c-48fd-8c02-1da065ff7e50 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:20.181229 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c3ec4193-406c-48fd-8c02-1da065ff7e50 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:20.181759 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c3ec4193-406c-48fd-8c02-1da065ff7e50 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:20.182384 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c3ec4193-406c-48fd-8c02-1da065ff7e50 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:20.239607 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-be683a0e-92e4-4289-ace6-adfad8db5f3f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:20.240303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-be683a0e-92e4-4289-ace6-adfad8db5f3f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:20.247568 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-be683a0e-92e4-4289-ace6-adfad8db5f3f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:20.248428 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-be683a0e-92e4-4289-ace6-adfad8db5f3f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:20.250312 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-be683a0e-92e4-4289-ace6-adfad8db5f3f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:20.251063 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-be683a0e-92e4-4289-ace6-adfad8db5f3f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:20.251693 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-be683a0e-92e4-4289-ace6-adfad8db5f3f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:20.252133 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-be683a0e-92e4-4289-ace6-adfad8db5f3f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:20.329873 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-be683a0e-92e4-4289-ace6-adfad8db5f3f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:20.339330 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-be683a0e-92e4-4289-ace6-adfad8db5f3f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1217 microversion: 2.1 time: 0.103824 Aug 29 21:53:20.340516 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 164/325] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:20 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:20.449134 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-c3ec4193-406c-48fd-8c02-1da065ff7e50 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:20.460598 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-c3ec4193-406c-48fd-8c02-1da065ff7e50 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:20.462793 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-c3ec4193-406c-48fd-8c02-1da065ff7e50 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:20.464107 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-c3ec4193-406c-48fd-8c02-1da065ff7e50 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.305658 Aug 29 21:53:20.464730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 162/326] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:20 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:53:20.658736 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-144ca463-ddd8-45c1-9ec9-c118a8304a01 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:20.660290 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-144ca463-ddd8-45c1-9ec9-c118a8304a01 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:20.676160 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-144ca463-ddd8-45c1-9ec9-c118a8304a01 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:20.676786 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-144ca463-ddd8-45c1-9ec9-c118a8304a01 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:20.677308 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-144ca463-ddd8-45c1-9ec9-c118a8304a01 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:20.678098 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-144ca463-ddd8-45c1-9ec9-c118a8304a01 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:20.678631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-144ca463-ddd8-45c1-9ec9-c118a8304a01 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:20.679062 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-144ca463-ddd8-45c1-9ec9-c118a8304a01 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:20.889313 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-144ca463-ddd8-45c1-9ec9-c118a8304a01 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:20.908955 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-144ca463-ddd8-45c1-9ec9-c118a8304a01 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.254292 Aug 29 21:53:20.909916 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 165/327] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:20 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:21.178080 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6b92d823-6f1c-4c59-99b6-6a955aadc233 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:21.178080 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6b92d823-6f1c-4c59-99b6-6a955aadc233 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:21.180624 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b92d823-6f1c-4c59-99b6-6a955aadc233 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:21.181121 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b92d823-6f1c-4c59-99b6-6a955aadc233 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:21.182123 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b92d823-6f1c-4c59-99b6-6a955aadc233 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:21.182909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b92d823-6f1c-4c59-99b6-6a955aadc233 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:21.183540 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b92d823-6f1c-4c59-99b6-6a955aadc233 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:21.184191 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b92d823-6f1c-4c59-99b6-6a955aadc233 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:21.364412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6b92d823-6f1c-4c59-99b6-6a955aadc233 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:21.365747 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ce2d868b-501d-42f8-bb8d-a98375d93d0e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:21.366813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ce2d868b-501d-42f8-bb8d-a98375d93d0e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:21.373949 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6b92d823-6f1c-4c59-99b6-6a955aadc233 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.206259 Aug 29 21:53:21.377243 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce2d868b-501d-42f8-bb8d-a98375d93d0e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:21.378526 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce2d868b-501d-42f8-bb8d-a98375d93d0e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:21.379457 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce2d868b-501d-42f8-bb8d-a98375d93d0e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:21.380900 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce2d868b-501d-42f8-bb8d-a98375d93d0e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:21.382319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce2d868b-501d-42f8-bb8d-a98375d93d0e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:21.383269 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce2d868b-501d-42f8-bb8d-a98375d93d0e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:21.389225 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 163/328] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:21 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:21.466388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ce2d868b-501d-42f8-bb8d-a98375d93d0e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:21.480323 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ce2d868b-501d-42f8-bb8d-a98375d93d0e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1217 microversion: 2.1 time: 0.122030 Aug 29 21:53:21.481413 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 166/329] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:21 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:21.493159 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4099e8c8-cba7-4df7-89d7-fa0fbc075d86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:21.493985 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4099e8c8-cba7-4df7-89d7-fa0fbc075d86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:21.500953 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4099e8c8-cba7-4df7-89d7-fa0fbc075d86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:21.504049 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4099e8c8-cba7-4df7-89d7-fa0fbc075d86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:21.504049 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4099e8c8-cba7-4df7-89d7-fa0fbc075d86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:21.504049 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4099e8c8-cba7-4df7-89d7-fa0fbc075d86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:21.504049 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4099e8c8-cba7-4df7-89d7-fa0fbc075d86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:21.504441 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4099e8c8-cba7-4df7-89d7-fa0fbc075d86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:21.679270 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4099e8c8-cba7-4df7-89d7-fa0fbc075d86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:21.682914 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4099e8c8-cba7-4df7-89d7-fa0fbc075d86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:21.684634 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4099e8c8-cba7-4df7-89d7-fa0fbc075d86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:21.686008 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4099e8c8-cba7-4df7-89d7-fa0fbc075d86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.197332 Aug 29 21:53:21.686748 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 164/330] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:21 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:21.932826 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d6c41792-d93e-45d3-b0e9-d3531c3c0815 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:21.933670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d6c41792-d93e-45d3-b0e9-d3531c3c0815 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:21.943180 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d6c41792-d93e-45d3-b0e9-d3531c3c0815 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:21.944112 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d6c41792-d93e-45d3-b0e9-d3531c3c0815 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:21.944957 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d6c41792-d93e-45d3-b0e9-d3531c3c0815 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:21.945897 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d6c41792-d93e-45d3-b0e9-d3531c3c0815 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:21.946557 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d6c41792-d93e-45d3-b0e9-d3531c3c0815 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:21.947766 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d6c41792-d93e-45d3-b0e9-d3531c3c0815 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:22.146902 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d6c41792-d93e-45d3-b0e9-d3531c3c0815 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:22.158906 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d6c41792-d93e-45d3-b0e9-d3531c3c0815 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.229546 Aug 29 21:53:22.159615 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 167/331] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:21 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:22.395318 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-385d231d-d04e-41eb-946a-db4cf71fdb4b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:22.395986 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-385d231d-d04e-41eb-946a-db4cf71fdb4b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:22.397930 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=4 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:22.403084 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-385d231d-d04e-41eb-946a-db4cf71fdb4b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:22.403575 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-385d231d-d04e-41eb-946a-db4cf71fdb4b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:22.404020 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-385d231d-d04e-41eb-946a-db4cf71fdb4b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:22.405186 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-385d231d-d04e-41eb-946a-db4cf71fdb4b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:22.405541 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-385d231d-d04e-41eb-946a-db4cf71fdb4b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:22.405993 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-385d231d-d04e-41eb-946a-db4cf71fdb4b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:22.502016 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-8d4a62eb-8d0c-46a4-b417-a54290bbd5a4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:22.502619 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-8d4a62eb-8d0c-46a4-b417-a54290bbd5a4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:22.509022 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8d4a62eb-8d0c-46a4-b417-a54290bbd5a4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:22.509775 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8d4a62eb-8d0c-46a4-b417-a54290bbd5a4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:22.510412 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8d4a62eb-8d0c-46a4-b417-a54290bbd5a4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:22.511386 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8d4a62eb-8d0c-46a4-b417-a54290bbd5a4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:22.512022 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8d4a62eb-8d0c-46a4-b417-a54290bbd5a4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:22.512581 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8d4a62eb-8d0c-46a4-b417-a54290bbd5a4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:22.554331 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-385d231d-d04e-41eb-946a-db4cf71fdb4b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:22.563192 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-385d231d-d04e-41eb-946a-db4cf71fdb4b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.171604 Aug 29 21:53:22.563903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 165/332] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:22 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:22.585761 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-8d4a62eb-8d0c-46a4-b417-a54290bbd5a4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:22.597423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-8d4a62eb-8d0c-46a4-b417-a54290bbd5a4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1217 microversion: 2.1 time: 0.098325 Aug 29 21:53:22.607268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 168/333] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:22 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:22.710642 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-9e2da0e8-e8a6-41dc-80a0-0ad992b4bf45 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:22.711248 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-9e2da0e8-e8a6-41dc-80a0-0ad992b4bf45 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:22.717538 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9e2da0e8-e8a6-41dc-80a0-0ad992b4bf45 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:22.718019 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9e2da0e8-e8a6-41dc-80a0-0ad992b4bf45 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:22.718440 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9e2da0e8-e8a6-41dc-80a0-0ad992b4bf45 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:22.719123 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9e2da0e8-e8a6-41dc-80a0-0ad992b4bf45 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:22.719571 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9e2da0e8-e8a6-41dc-80a0-0ad992b4bf45 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:22.719997 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9e2da0e8-e8a6-41dc-80a0-0ad992b4bf45 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:22.738326 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=100 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:22.861164 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9e2da0e8-e8a6-41dc-80a0-0ad992b4bf45 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:22.870319 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9e2da0e8-e8a6-41dc-80a0-0ad992b4bf45 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:22.871847 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9e2da0e8-e8a6-41dc-80a0-0ad992b4bf45 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:22.873117 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-9e2da0e8-e8a6-41dc-80a0-0ad992b4bf45 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.166378 Aug 29 21:53:22.873673 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 166/334] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:22 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:23.182299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-86afb567-3764-4ec0-9f1f-832457645b81 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:23.182996 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-86afb567-3764-4ec0-9f1f-832457645b81 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:23.191018 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-86afb567-3764-4ec0-9f1f-832457645b81 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:23.191604 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-86afb567-3764-4ec0-9f1f-832457645b81 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:23.192105 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-86afb567-3764-4ec0-9f1f-832457645b81 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:23.192840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-86afb567-3764-4ec0-9f1f-832457645b81 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:23.193625 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-86afb567-3764-4ec0-9f1f-832457645b81 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:23.197442 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-86afb567-3764-4ec0-9f1f-832457645b81 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:23.326685 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-86afb567-3764-4ec0-9f1f-832457645b81 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:23.334437 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-86afb567-3764-4ec0-9f1f-832457645b81 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.157655 Aug 29 21:53:23.335005 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 169/335] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:23 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:23.586489 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-66db50b6-641f-48c5-9c8f-d2905d8fa7aa tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:23.588276 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-66db50b6-641f-48c5-9c8f-d2905d8fa7aa tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:23.590773 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=16 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:23.599741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-66db50b6-641f-48c5-9c8f-d2905d8fa7aa tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:23.600283 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-66db50b6-641f-48c5-9c8f-d2905d8fa7aa tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:23.601189 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-66db50b6-641f-48c5-9c8f-d2905d8fa7aa tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:23.602076 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-66db50b6-641f-48c5-9c8f-d2905d8fa7aa tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:23.602904 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-66db50b6-641f-48c5-9c8f-d2905d8fa7aa tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:23.603966 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-66db50b6-641f-48c5-9c8f-d2905d8fa7aa tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:23.621149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4152cfcf-2a17-430c-925f-dff8a33dc8e4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:23.627960 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4152cfcf-2a17-430c-925f-dff8a33dc8e4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:23.635915 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4152cfcf-2a17-430c-925f-dff8a33dc8e4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:23.636431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4152cfcf-2a17-430c-925f-dff8a33dc8e4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:23.636896 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4152cfcf-2a17-430c-925f-dff8a33dc8e4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:23.637702 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4152cfcf-2a17-430c-925f-dff8a33dc8e4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:23.638065 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4152cfcf-2a17-430c-925f-dff8a33dc8e4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:23.638662 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4152cfcf-2a17-430c-925f-dff8a33dc8e4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:23.719312 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4152cfcf-2a17-430c-925f-dff8a33dc8e4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:23.732644 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4152cfcf-2a17-430c-925f-dff8a33dc8e4 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1217 microversion: 2.1 time: 0.117061 Aug 29 21:53:23.733237 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 170/336] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:23 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:23.769605 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-66db50b6-641f-48c5-9c8f-d2905d8fa7aa tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:23.783099 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-66db50b6-641f-48c5-9c8f-d2905d8fa7aa tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.200075 Aug 29 21:53:23.784155 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 167/337] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:23 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:23.895743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e6e1815b-c54d-40ff-bf69-92927ba5f765 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:23.896354 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-e6e1815b-c54d-40ff-bf69-92927ba5f765 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:23.902899 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6e1815b-c54d-40ff-bf69-92927ba5f765 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:23.903383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6e1815b-c54d-40ff-bf69-92927ba5f765 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:23.903816 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6e1815b-c54d-40ff-bf69-92927ba5f765 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:23.904860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6e1815b-c54d-40ff-bf69-92927ba5f765 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:23.905315 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6e1815b-c54d-40ff-bf69-92927ba5f765 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:23.905811 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6e1815b-c54d-40ff-bf69-92927ba5f765 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:24.061744 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e6e1815b-c54d-40ff-bf69-92927ba5f765 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:24.078520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e6e1815b-c54d-40ff-bf69-92927ba5f765 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:24.081629 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e6e1815b-c54d-40ff-bf69-92927ba5f765 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:24.083832 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e6e1815b-c54d-40ff-bf69-92927ba5f765 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.192011 Aug 29 21:53:24.084867 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 171/338] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:23 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:24.358575 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d285a2f6-a859-4e6b-a7d1-155b351a695b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:24.359216 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d285a2f6-a859-4e6b-a7d1-155b351a695b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:24.365856 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d285a2f6-a859-4e6b-a7d1-155b351a695b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:24.366351 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d285a2f6-a859-4e6b-a7d1-155b351a695b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:24.366794 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d285a2f6-a859-4e6b-a7d1-155b351a695b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:24.367690 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d285a2f6-a859-4e6b-a7d1-155b351a695b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:24.367943 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d285a2f6-a859-4e6b-a7d1-155b351a695b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:24.368371 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d285a2f6-a859-4e6b-a7d1-155b351a695b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:24.504840 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d285a2f6-a859-4e6b-a7d1-155b351a695b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:24.512550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d285a2f6-a859-4e6b-a7d1-155b351a695b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.159155 Aug 29 21:53:24.513119 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 168/339] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:24 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:24.754575 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d7e2868a-9dac-4c99-b44a-85368761a0e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:24.755173 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d7e2868a-9dac-4c99-b44a-85368761a0e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:24.761914 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d7e2868a-9dac-4c99-b44a-85368761a0e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:24.762472 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d7e2868a-9dac-4c99-b44a-85368761a0e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:24.762908 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d7e2868a-9dac-4c99-b44a-85368761a0e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:24.763621 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d7e2868a-9dac-4c99-b44a-85368761a0e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:24.764080 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d7e2868a-9dac-4c99-b44a-85368761a0e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:24.764530 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d7e2868a-9dac-4c99-b44a-85368761a0e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:24.804754 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6b24727e-a268-4edb-97ea-2dee3293d86c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:24.805372 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6b24727e-a268-4edb-97ea-2dee3293d86c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:24.812552 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b24727e-a268-4edb-97ea-2dee3293d86c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:24.813142 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b24727e-a268-4edb-97ea-2dee3293d86c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:24.813491 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b24727e-a268-4edb-97ea-2dee3293d86c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:24.814207 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b24727e-a268-4edb-97ea-2dee3293d86c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:24.814659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b24727e-a268-4edb-97ea-2dee3293d86c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:24.815087 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b24727e-a268-4edb-97ea-2dee3293d86c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:24.831303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d7e2868a-9dac-4c99-b44a-85368761a0e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:24.840060 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d7e2868a-9dac-4c99-b44a-85368761a0e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1209 microversion: 2.1 time: 0.089207 Aug 29 21:53:24.840680 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 172/340] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:24 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:24.958580 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6b24727e-a268-4edb-97ea-2dee3293d86c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:24.966435 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6b24727e-a268-4edb-97ea-2dee3293d86c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.165606 Aug 29 21:53:24.966932 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 169/341] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:24 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:25.129952 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-11834349-d9f9-473f-92f0-851589736f04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:25.131224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-11834349-d9f9-473f-92f0-851589736f04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:25.138167 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11834349-d9f9-473f-92f0-851589736f04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:25.138782 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11834349-d9f9-473f-92f0-851589736f04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:25.139130 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11834349-d9f9-473f-92f0-851589736f04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:25.139864 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11834349-d9f9-473f-92f0-851589736f04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:25.140382 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11834349-d9f9-473f-92f0-851589736f04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:25.140843 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11834349-d9f9-473f-92f0-851589736f04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:25.165251 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=100 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:25.346421 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-11834349-d9f9-473f-92f0-851589736f04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:25.355985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-11834349-d9f9-473f-92f0-851589736f04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:25.358418 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-11834349-d9f9-473f-92f0-851589736f04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:25.359592 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-11834349-d9f9-473f-92f0-851589736f04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.250945 Aug 29 21:53:25.360141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 173/342] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:25 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:25.533930 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-07e1f270-594c-4d9c-bf20-f284edb6c0d7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:25.534496 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-07e1f270-594c-4d9c-bf20-f284edb6c0d7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:25.541047 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-07e1f270-594c-4d9c-bf20-f284edb6c0d7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:25.541568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-07e1f270-594c-4d9c-bf20-f284edb6c0d7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:25.542025 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-07e1f270-594c-4d9c-bf20-f284edb6c0d7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:25.542731 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-07e1f270-594c-4d9c-bf20-f284edb6c0d7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:25.543189 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-07e1f270-594c-4d9c-bf20-f284edb6c0d7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:25.543613 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-07e1f270-594c-4d9c-bf20-f284edb6c0d7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:25.694794 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-07e1f270-594c-4d9c-bf20-f284edb6c0d7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:25.703598 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-07e1f270-594c-4d9c-bf20-f284edb6c0d7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.173657 Aug 29 21:53:25.704242 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 170/343] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:25 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:25.865768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d33098e3-d9cc-48de-8c8a-a6eac521b3de tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:25.866371 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d33098e3-d9cc-48de-8c8a-a6eac521b3de tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:25.873144 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d33098e3-d9cc-48de-8c8a-a6eac521b3de tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:25.873709 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d33098e3-d9cc-48de-8c8a-a6eac521b3de tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:25.874088 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d33098e3-d9cc-48de-8c8a-a6eac521b3de tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:25.874863 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d33098e3-d9cc-48de-8c8a-a6eac521b3de tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:25.875320 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d33098e3-d9cc-48de-8c8a-a6eac521b3de tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:25.875747 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d33098e3-d9cc-48de-8c8a-a6eac521b3de tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:25.938593 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d33098e3-d9cc-48de-8c8a-a6eac521b3de tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:25.947452 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d33098e3-d9cc-48de-8c8a-a6eac521b3de tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1265 microversion: 2.1 time: 0.085825 Aug 29 21:53:25.948034 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 174/344] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:25 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:25.987597 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4ae85e09-1798-4e9f-a596-2c08e4cf9c64 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:25.988209 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4ae85e09-1798-4e9f-a596-2c08e4cf9c64 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:25.995360 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ae85e09-1798-4e9f-a596-2c08e4cf9c64 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:25.995862 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ae85e09-1798-4e9f-a596-2c08e4cf9c64 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:25.996294 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ae85e09-1798-4e9f-a596-2c08e4cf9c64 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:25.997020 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ae85e09-1798-4e9f-a596-2c08e4cf9c64 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:25.997480 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ae85e09-1798-4e9f-a596-2c08e4cf9c64 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:25.997908 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ae85e09-1798-4e9f-a596-2c08e4cf9c64 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:26.131351 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4ae85e09-1798-4e9f-a596-2c08e4cf9c64 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:26.139908 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4ae85e09-1798-4e9f-a596-2c08e4cf9c64 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.156232 Aug 29 21:53:26.140505 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 171/345] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:25 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:26.381637 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c45b3204-ab9b-4cce-a024-abefb6c1b7c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:26.382238 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c45b3204-ab9b-4cce-a024-abefb6c1b7c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:26.388309 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c45b3204-ab9b-4cce-a024-abefb6c1b7c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:26.388833 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c45b3204-ab9b-4cce-a024-abefb6c1b7c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:26.389290 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c45b3204-ab9b-4cce-a024-abefb6c1b7c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:26.389981 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c45b3204-ab9b-4cce-a024-abefb6c1b7c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:26.390435 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c45b3204-ab9b-4cce-a024-abefb6c1b7c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:26.390859 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c45b3204-ab9b-4cce-a024-abefb6c1b7c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:26.527605 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c45b3204-ab9b-4cce-a024-abefb6c1b7c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:26.536285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c45b3204-ab9b-4cce-a024-abefb6c1b7c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:26.537769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c45b3204-ab9b-4cce-a024-abefb6c1b7c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:26.538936 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c45b3204-ab9b-4cce-a024-abefb6c1b7c8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.161306 Aug 29 21:53:26.539489 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 175/346] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:26 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:26.729949 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d6a8d21d-3169-4009-aa8c-4550eae53b13 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:26.729949 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d6a8d21d-3169-4009-aa8c-4550eae53b13 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:26.734728 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d6a8d21d-3169-4009-aa8c-4550eae53b13 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:26.735233 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d6a8d21d-3169-4009-aa8c-4550eae53b13 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:26.735684 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d6a8d21d-3169-4009-aa8c-4550eae53b13 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:26.736429 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d6a8d21d-3169-4009-aa8c-4550eae53b13 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:26.739200 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d6a8d21d-3169-4009-aa8c-4550eae53b13 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:26.739200 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d6a8d21d-3169-4009-aa8c-4550eae53b13 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:26.921817 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d6a8d21d-3169-4009-aa8c-4550eae53b13 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:26.953238 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d6a8d21d-3169-4009-aa8c-4550eae53b13 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.217777 Aug 29 21:53:26.953238 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 172/347] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:26 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:26.973943 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e1d725da-e8e2-4c33-a074-e9f5fb1bd23c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:26.975206 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-e1d725da-e8e2-4c33-a074-e9f5fb1bd23c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:26.998121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e1d725da-e8e2-4c33-a074-e9f5fb1bd23c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:26.998538 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e1d725da-e8e2-4c33-a074-e9f5fb1bd23c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:26.998975 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e1d725da-e8e2-4c33-a074-e9f5fb1bd23c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:26.999889 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e1d725da-e8e2-4c33-a074-e9f5fb1bd23c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:27.000624 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e1d725da-e8e2-4c33-a074-e9f5fb1bd23c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:27.001236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e1d725da-e8e2-4c33-a074-e9f5fb1bd23c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:27.161143 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-14b5d34a-0909-4c1d-8892-1a2addea38b7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:27.161770 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-14b5d34a-0909-4c1d-8892-1a2addea38b7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:27.168629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-14b5d34a-0909-4c1d-8892-1a2addea38b7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:27.169120 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-14b5d34a-0909-4c1d-8892-1a2addea38b7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:27.169558 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-14b5d34a-0909-4c1d-8892-1a2addea38b7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:27.170514 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-14b5d34a-0909-4c1d-8892-1a2addea38b7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:27.170970 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-14b5d34a-0909-4c1d-8892-1a2addea38b7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:27.171395 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-14b5d34a-0909-4c1d-8892-1a2addea38b7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:27.249967 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e1d725da-e8e2-4c33-a074-e9f5fb1bd23c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:27.262770 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e1d725da-e8e2-4c33-a074-e9f5fb1bd23c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1265 microversion: 2.1 time: 0.296666 Aug 29 21:53:27.264144 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 176/348] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:26 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:27.332462 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-14b5d34a-0909-4c1d-8892-1a2addea38b7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:27.341153 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-14b5d34a-0909-4c1d-8892-1a2addea38b7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.183795 Aug 29 21:53:27.341816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 173/349] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:27 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:27.563181 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c3f0f326-5612-46ce-9827-e4c6e7efea43 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:27.563804 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c3f0f326-5612-46ce-9827-e4c6e7efea43 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:27.570082 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c3f0f326-5612-46ce-9827-e4c6e7efea43 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:27.570572 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c3f0f326-5612-46ce-9827-e4c6e7efea43 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:27.571017 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c3f0f326-5612-46ce-9827-e4c6e7efea43 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:27.571736 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c3f0f326-5612-46ce-9827-e4c6e7efea43 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:27.572195 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c3f0f326-5612-46ce-9827-e4c6e7efea43 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:27.572650 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c3f0f326-5612-46ce-9827-e4c6e7efea43 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:27.745611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c3f0f326-5612-46ce-9827-e4c6e7efea43 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:27.764577 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c3f0f326-5612-46ce-9827-e4c6e7efea43 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:27.767898 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c3f0f326-5612-46ce-9827-e4c6e7efea43 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:27.770238 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c3f0f326-5612-46ce-9827-e4c6e7efea43 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.211233 Aug 29 21:53:27.771371 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 177/350] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:27 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:27.971459 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ad73fa02-be64-4206-97f5-1f4df4351a63 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:27.972027 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ad73fa02-be64-4206-97f5-1f4df4351a63 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:27.979317 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ad73fa02-be64-4206-97f5-1f4df4351a63 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:27.979819 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ad73fa02-be64-4206-97f5-1f4df4351a63 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:27.980264 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ad73fa02-be64-4206-97f5-1f4df4351a63 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:27.981032 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ad73fa02-be64-4206-97f5-1f4df4351a63 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:27.981497 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ad73fa02-be64-4206-97f5-1f4df4351a63 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:27.981963 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ad73fa02-be64-4206-97f5-1f4df4351a63 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:28.134947 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ad73fa02-be64-4206-97f5-1f4df4351a63 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:28.143612 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ad73fa02-be64-4206-97f5-1f4df4351a63 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.176116 Aug 29 21:53:28.144199 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 174/351] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:27 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:28.228217 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1556272327", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1130395365", "security_groups": [{"name": "tempest-secgroup-smoke-1764459195"}], "networks": [{"uuid": "0b44899c-34aa-4ed6-b8d1-dec55dd4c1f0"}], "block_device_mapping_v2": [{"uuid": "1bc1fedb-5f90-4aae-aa4f-859d24183b1d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:28.290797 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4ca45ef3-70e9-4600-a83f-dbe52c52dce2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:28.291927 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4ca45ef3-70e9-4600-a83f-dbe52c52dce2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:28.341535 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ca45ef3-70e9-4600-a83f-dbe52c52dce2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:28.342780 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ca45ef3-70e9-4600-a83f-dbe52c52dce2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:28.345219 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ca45ef3-70e9-4600-a83f-dbe52c52dce2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:28.347602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ca45ef3-70e9-4600-a83f-dbe52c52dce2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:28.353827 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ca45ef3-70e9-4600-a83f-dbe52c52dce2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:28.354729 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ca45ef3-70e9-4600-a83f-dbe52c52dce2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:28.461788 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4ca45ef3-70e9-4600-a83f-dbe52c52dce2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:28.471047 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4ca45ef3-70e9-4600-a83f-dbe52c52dce2 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1273 microversion: 2.1 time: 0.187429 Aug 29 21:53:28.471751 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 175/352] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:28 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1273 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:28.489211 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0383c59c-3004-4a4c-bf17-268d527448d1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:28.491513 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0383c59c-3004-4a4c-bf17-268d527448d1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:28.494167 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:28.499578 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0383c59c-3004-4a4c-bf17-268d527448d1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:28.500078 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0383c59c-3004-4a4c-bf17-268d527448d1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:28.500767 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0383c59c-3004-4a4c-bf17-268d527448d1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:28.501785 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0383c59c-3004-4a4c-bf17-268d527448d1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:28.502464 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0383c59c-3004-4a4c-bf17-268d527448d1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:28.503641 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0383c59c-3004-4a4c-bf17-268d527448d1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:28.609142 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.network.neutron [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] validate_networks() for [('0b44899c-34aa-4ed6-b8d1-dec55dd4c1f0', None, None, None, None, None)] {{(pid=127882) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:53:28.715945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0383c59c-3004-4a4c-bf17-268d527448d1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:28.724813 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0383c59c-3004-4a4c-bf17-268d527448d1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.239877 Aug 29 21:53:28.725659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 176/353] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:28 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:28.805147 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-1c9f6503-c7a6-4ef1-ac8c-e76fa8c26344 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:28.806050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-1c9f6503-c7a6-4ef1-ac8c-e76fa8c26344 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:28.813879 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c9f6503-c7a6-4ef1-ac8c-e76fa8c26344 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:28.814911 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c9f6503-c7a6-4ef1-ac8c-e76fa8c26344 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:28.815824 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c9f6503-c7a6-4ef1-ac8c-e76fa8c26344 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:28.817270 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c9f6503-c7a6-4ef1-ac8c-e76fa8c26344 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:28.818283 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c9f6503-c7a6-4ef1-ac8c-e76fa8c26344 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:28.819120 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c9f6503-c7a6-4ef1-ac8c-e76fa8c26344 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:29.004244 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-1c9f6503-c7a6-4ef1-ac8c-e76fa8c26344 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:29.017508 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-1c9f6503-c7a6-4ef1-ac8c-e76fa8c26344 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:29.018909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-1c9f6503-c7a6-4ef1-ac8c-e76fa8c26344 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:29.020433 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-1c9f6503-c7a6-4ef1-ac8c-e76fa8c26344 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.224338 Aug 29 21:53:29.021044 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 177/354] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:28 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:53:29.025729 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-af23b1fb-879b-4217-8477-5f1b424ecbd1 req-cf1b920c-5037-48d0-9dfa-2d18128d4a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e60ebcd-98c1-4442-9c72-f4d9760c8d6f", "name": "network-vif-plugged", "status": "completed", "tag": "b49d987f-0fff-47f7-acee-6d31bbdeab4b"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:29.035308 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-af23b1fb-879b-4217-8477-5f1b424ecbd1 req-cf1b920c-5037-48d0-9dfa-2d18128d4a30 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:29.035791 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-af23b1fb-879b-4217-8477-5f1b424ecbd1 req-cf1b920c-5037-48d0-9dfa-2d18128d4a30 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:29.036225 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-af23b1fb-879b-4217-8477-5f1b424ecbd1 req-cf1b920c-5037-48d0-9dfa-2d18128d4a30 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:29.048448 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-af23b1fb-879b-4217-8477-5f1b424ecbd1 req-cf1b920c-5037-48d0-9dfa-2d18128d4a30 service nova] Creating event network-vif-plugged:b49d987f-0fff-47f7-acee-6d31bbdeab4b for instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f on hv-cinder-85426 Aug 29 21:53:29.053574 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-af23b1fb-879b-4217-8477-5f1b424ecbd1 req-cf1b920c-5037-48d0-9dfa-2d18128d4a30 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031390 Aug 29 21:53:29.054410 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 178/355] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:53:29.068081 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Flavor limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:53:29.068524 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Image limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:53:29.068992 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Flavor pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:53:29.069394 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Image pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:53:29.069826 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:53:29.080225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:29.080733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:29.081163 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:29.081880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:29.082321 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:29.082737 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:29.100533 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Getting quotas for project 2b08d1c1dcf64187b53e4e3a76b6e346. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:53:29.104454 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Getting quotas for user 297a016ff2944b33a06d5ce81735fb8d and project 2b08d1c1dcf64187b53e4e3a76b6e346. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:53:29.169591 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-aa1221be-5398-49d2-bd8e-a927477dcb49 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:29.169591 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-aa1221be-5398-49d2-bd8e-a927477dcb49 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:29.170867 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Going to run 1 instances... {{(pid=127882) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:53:29.173073 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1bc1fedb-5f90-4aae-aa4f-859d24183b1d',volume_size=None,volume_type=None)] {{(pid=127882) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:53:29.175125 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-aa1221be-5398-49d2-bd8e-a927477dcb49 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:29.175626 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-aa1221be-5398-49d2-bd8e-a927477dcb49 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:29.176065 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-aa1221be-5398-49d2-bd8e-a927477dcb49 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:29.176802 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-aa1221be-5398-49d2-bd8e-a927477dcb49 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:29.177270 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-aa1221be-5398-49d2-bd8e-a927477dcb49 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:29.178059 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-aa1221be-5398-49d2-bd8e-a927477dcb49 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:29.335554 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-aa1221be-5398-49d2-bd8e-a927477dcb49 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:29.344935 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-aa1221be-5398-49d2-bd8e-a927477dcb49 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.181402 Aug 29 21:53:29.345558 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 179/356] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:29 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:29.499152 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a7c85e46-9189-49d7-be68-756ba91a607e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:29.500515 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a7c85e46-9189-49d7-be68-756ba91a607e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:29.517476 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a7c85e46-9189-49d7-be68-756ba91a607e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:29.518494 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a7c85e46-9189-49d7-be68-756ba91a607e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:29.519430 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a7c85e46-9189-49d7-be68-756ba91a607e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:29.520663 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a7c85e46-9189-49d7-be68-756ba91a607e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:29.521358 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a7c85e46-9189-49d7-be68-756ba91a607e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:29.524722 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a7c85e46-9189-49d7-be68-756ba91a607e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:29.607193 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a7c85e46-9189-49d7-be68-756ba91a607e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:29.615613 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a7c85e46-9189-49d7-be68-756ba91a607e tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1271 microversion: 2.1 time: 0.126470 Aug 29 21:53:29.616218 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 180/357] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:29 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:29.757428 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-01d13406-4c20-4b61-9fe0-06f709c8c872 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:29.758036 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-01d13406-4c20-4b61-9fe0-06f709c8c872 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:29.764124 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-01d13406-4c20-4b61-9fe0-06f709c8c872 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:29.764779 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-01d13406-4c20-4b61-9fe0-06f709c8c872 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:29.765219 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-01d13406-4c20-4b61-9fe0-06f709c8c872 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:29.765912 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-01d13406-4c20-4b61-9fe0-06f709c8c872 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:29.766363 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-01d13406-4c20-4b61-9fe0-06f709c8c872 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:29.766783 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-01d13406-4c20-4b61-9fe0-06f709c8c872 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:29.913839 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-01d13406-4c20-4b61-9fe0-06f709c8c872 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:29.917383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-66132138-e437-4170-9b0e-865b3330f081 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.698195 Aug 29 21:53:29.918301 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 178/358] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:53:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:53:29.924540 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-01d13406-4c20-4b61-9fe0-06f709c8c872 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.170754 Aug 29 21:53:29.925124 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 181/359] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:29 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:29.933424 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4966e3b6-4b01-474c-998f-008c79b4a92f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:29.934082 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4966e3b6-4b01-474c-998f-008c79b4a92f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:30.052411 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-204496ef-12f9-44ac-99a7-3b008fcea484 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:30.054345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-204496ef-12f9-44ac-99a7-3b008fcea484 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:30.073826 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4966e3b6-4b01-474c-998f-008c79b4a92f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:30.079362 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-204496ef-12f9-44ac-99a7-3b008fcea484 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:30.079991 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-204496ef-12f9-44ac-99a7-3b008fcea484 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:30.080450 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-204496ef-12f9-44ac-99a7-3b008fcea484 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:30.088216 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-204496ef-12f9-44ac-99a7-3b008fcea484 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:30.089000 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-204496ef-12f9-44ac-99a7-3b008fcea484 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:30.089424 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-204496ef-12f9-44ac-99a7-3b008fcea484 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:30.113758 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4966e3b6-4b01-474c-998f-008c79b4a92f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1089 microversion: 2.1 time: 0.182366 Aug 29 21:53:30.115600 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 179/360] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:29 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1089 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:30.335684 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-204496ef-12f9-44ac-99a7-3b008fcea484 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:30.346829 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-204496ef-12f9-44ac-99a7-3b008fcea484 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:30.350580 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-204496ef-12f9-44ac-99a7-3b008fcea484 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:30.350580 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-204496ef-12f9-44ac-99a7-3b008fcea484 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.309355 Aug 29 21:53:30.350871 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 182/361] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:30 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:53:30.367674 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-8cfaf09e-7e40-4079-9180-8dd9b9a03b6b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:30.368289 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-8cfaf09e-7e40-4079-9180-8dd9b9a03b6b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:30.375926 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cfaf09e-7e40-4079-9180-8dd9b9a03b6b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:30.376376 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cfaf09e-7e40-4079-9180-8dd9b9a03b6b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:30.376842 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cfaf09e-7e40-4079-9180-8dd9b9a03b6b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:30.377559 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cfaf09e-7e40-4079-9180-8dd9b9a03b6b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:30.378017 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cfaf09e-7e40-4079-9180-8dd9b9a03b6b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:30.378470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cfaf09e-7e40-4079-9180-8dd9b9a03b6b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:30.566616 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-8cfaf09e-7e40-4079-9180-8dd9b9a03b6b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:30.576405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-8cfaf09e-7e40-4079-9180-8dd9b9a03b6b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1501 microversion: 2.1 time: 0.212616 Aug 29 21:53:30.595873 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 180/362] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:30 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1501 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:30.602090 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a52ad427-fdc2-49df-8090-1d969f41e051 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9383968c-6eed-4ddf-a3da-668a1ae6b223"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:30.605311 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a52ad427-fdc2-49df-8090-1d969f41e051 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:30.612098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a52ad427-fdc2-49df-8090-1d969f41e051 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:30.621367 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a52ad427-fdc2-49df-8090-1d969f41e051 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:30.621832 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a52ad427-fdc2-49df-8090-1d969f41e051 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:30.622579 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a52ad427-fdc2-49df-8090-1d969f41e051 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:30.623046 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a52ad427-fdc2-49df-8090-1d969f41e051 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:30.623468 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a52ad427-fdc2-49df-8090-1d969f41e051 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:30.640790 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-49d1340d-744d-45a5-8e59-fa9491903c76 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:30.641429 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-49d1340d-744d-45a5-8e59-fa9491903c76 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:30.649707 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-49d1340d-744d-45a5-8e59-fa9491903c76 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:30.650927 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-49d1340d-744d-45a5-8e59-fa9491903c76 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:30.651378 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-49d1340d-744d-45a5-8e59-fa9491903c76 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:30.652071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-49d1340d-744d-45a5-8e59-fa9491903c76 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:30.652549 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-49d1340d-744d-45a5-8e59-fa9491903c76 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:30.653151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-49d1340d-744d-45a5-8e59-fa9491903c76 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:30.657782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-a52ad427-fdc2-49df-8090-1d969f41e051 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] HTTP exception thrown: Cannot 'attach_volume' instance 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 while it is in vm_state rescued Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a52ad427-fdc2-49df-8090-1d969f41e051 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Request method failure captured: Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: POST /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8/os-volume_attachments HTTP/1.1 Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 74 Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTUBV54KXufTxPgBAlndN0DEguNRKzSRmEC5xewb2lPPOimeyFRSKSE-6O1bForpBT9-ggR6RsNJabRPmDZZQOEUgzIPpDU_UHM7JinN8BmN7CaDpBTpPmSAVaL8wDeAim5TRDVnE7RSL44Ykqa0DQF0eZupQ_CRNGNzjBu6MIoH0-w Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: f8ca070dc59e4a69bdaca0150f92bcc4 Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1630666147 Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 21:53:30.659730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 21:53:30.661396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:53:30.661396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1630666147 Aug 29 21:53:30.661396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: f8ca070dc59e4a69bdaca0150f92bcc4 Aug 29 21:53:30.661396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1630666147 Aug 29 21:53:30.661396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-ServerRescueNegativeTestJSON-1630666147-project Aug 29 21:53:30.661396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 21:53:30.661396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 21:53:30.661396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 3575098818954a949e202397a1b20a6a Aug 29 21:53:30.661396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1630666147-project Aug 29 21:53:30.661396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Aug 29 21:53:30.661396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {"volumeAttachment": {"volumeId": "9383968c-6eed-4ddf-a3da-668a1ae6b223"}} Aug 29 21:53:30.661396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Cannot 'attach_volume' instance 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 while it is in vm_state rescued Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'server_id': '64a4fc48-d58f-4227-a8aa-5d4d227c33d8', 'body': {'volumeAttachment': {'volumeId': '9383968c-6eed-4ddf-a3da-668a1ae6b223'}}} Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:53:30.662446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 while it is in vm_state rescued Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:53:30.663744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:53:30.665209 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:53:30.665209 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:53:30.665209 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 while it is in vm_state rescued Aug 29 21:53:30.665209 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:53:30.665209 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a52ad427-fdc2-49df-8090-1d969f41e051 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Returning 409 to user: Cannot 'attach_volume' instance 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 while it is in vm_state rescued {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:53:30.665209 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a52ad427-fdc2-49df-8090-1d969f41e051 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "POST /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.066432 Aug 29 21:53:30.665209 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 183/363] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 21:53:30 2022] POST /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8/os-volume_attachments => generated 152 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 29 21:53:30.684713 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-1f9e5e19-0722-4ad8-ac1e-6a00f0e6c143 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:30.685803 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-1f9e5e19-0722-4ad8-ac1e-6a00f0e6c143 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:30.692814 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1f9e5e19-0722-4ad8-ac1e-6a00f0e6c143 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:30.692814 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1f9e5e19-0722-4ad8-ac1e-6a00f0e6c143 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:30.693184 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1f9e5e19-0722-4ad8-ac1e-6a00f0e6c143 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:30.694556 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1f9e5e19-0722-4ad8-ac1e-6a00f0e6c143 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:30.695019 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1f9e5e19-0722-4ad8-ac1e-6a00f0e6c143 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:30.695450 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1f9e5e19-0722-4ad8-ac1e-6a00f0e6c143 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:30.700617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=100 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:30.875363 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-49d1340d-744d-45a5-8e59-fa9491903c76 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:30.885581 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-49d1340d-744d-45a5-8e59-fa9491903c76 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.250078 Aug 29 21:53:30.886182 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 181/364] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:30 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:30.946909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0fd86831-6379-4db9-83f7-9e49601fd504 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:30.947775 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-0fd86831-6379-4db9-83f7-9e49601fd504 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:30.955670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0fd86831-6379-4db9-83f7-9e49601fd504 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:30.956253 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0fd86831-6379-4db9-83f7-9e49601fd504 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:30.963043 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0fd86831-6379-4db9-83f7-9e49601fd504 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:30.963043 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0fd86831-6379-4db9-83f7-9e49601fd504 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:30.963043 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0fd86831-6379-4db9-83f7-9e49601fd504 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:30.963043 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0fd86831-6379-4db9-83f7-9e49601fd504 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:31.041617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-1f9e5e19-0722-4ad8-ac1e-6a00f0e6c143 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "POST /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8/action" status: 202 len: 0 microversion: 2.1 time: 0.366578 Aug 29 21:53:31.041617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 184/365] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 21:53:30 2022] POST /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:53:31.048913 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-dc3b5c41-6767-4f9a-bf26-15f2864ceaea tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:31.049623 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-dc3b5c41-6767-4f9a-bf26-15f2864ceaea tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:31.066249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dc3b5c41-6767-4f9a-bf26-15f2864ceaea tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:31.067375 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dc3b5c41-6767-4f9a-bf26-15f2864ceaea tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:31.067983 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dc3b5c41-6767-4f9a-bf26-15f2864ceaea tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:31.068912 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dc3b5c41-6767-4f9a-bf26-15f2864ceaea tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:31.069515 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dc3b5c41-6767-4f9a-bf26-15f2864ceaea tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:31.083936 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dc3b5c41-6767-4f9a-bf26-15f2864ceaea tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:31.299853 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-0fd86831-6379-4db9-83f7-9e49601fd504 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:31.310072 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-0fd86831-6379-4db9-83f7-9e49601fd504 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.367773 Aug 29 21:53:31.311044 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 182/366] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:30 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:31.317059 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ba986ffd-199b-4bab-919f-658c65a11289 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:31.317873 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ba986ffd-199b-4bab-919f-658c65a11289 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:31.333825 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba986ffd-199b-4bab-919f-658c65a11289 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:31.335389 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba986ffd-199b-4bab-919f-658c65a11289 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:31.337885 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba986ffd-199b-4bab-919f-658c65a11289 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:31.340685 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba986ffd-199b-4bab-919f-658c65a11289 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:31.341238 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba986ffd-199b-4bab-919f-658c65a11289 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:31.341710 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba986ffd-199b-4bab-919f-658c65a11289 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:31.546595 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-ba986ffd-199b-4bab-919f-658c65a11289 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lazy-loading 'services' on Instance uuid 93cc4db2-465f-41c0-8689-d78cccae7601 {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:53:31.635535 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-dc3b5c41-6767-4f9a-bf26-15f2864ceaea tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:31.647944 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-dc3b5c41-6767-4f9a-bf26-15f2864ceaea tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1509 microversion: 2.1 time: 0.604362 Aug 29 21:53:31.653954 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 185/367] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:31 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1509 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:31.658833 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-98a78b4f-854c-4563-bac5-b467cd002fce tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:31.661750 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-98a78b4f-854c-4563-bac5-b467cd002fce tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:31.811172 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-98a78b4f-854c-4563-bac5-b467cd002fce tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:31.824681 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-98a78b4f-854c-4563-bac5-b467cd002fce tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1089 microversion: 2.1 time: 0.168827 Aug 29 21:53:31.825522 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 186/368] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:31 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1089 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:31.831133 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e0ba438a-2bda-486d-8b01-a78a5eb839fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:31.831968 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e0ba438a-2bda-486d-8b01-a78a5eb839fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:31.843413 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e0ba438a-2bda-486d-8b01-a78a5eb839fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:31.844117 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e0ba438a-2bda-486d-8b01-a78a5eb839fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:31.844794 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e0ba438a-2bda-486d-8b01-a78a5eb839fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:31.845670 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e0ba438a-2bda-486d-8b01-a78a5eb839fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:31.846291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e0ba438a-2bda-486d-8b01-a78a5eb839fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:31.846880 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e0ba438a-2bda-486d-8b01-a78a5eb839fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:32.030477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e0ba438a-2bda-486d-8b01-a78a5eb839fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:32.037454 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ba986ffd-199b-4bab-919f-658c65a11289 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "DELETE /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/os-volume_attachments/ab2a4a6e-be26-4ae7-9f07-c01d98ce2b06" status: 202 len: 0 microversion: 2.1 time: 0.724776 Aug 29 21:53:32.042955 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 183/369] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 21:53:31 2022] DELETE /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/os-volume_attachments/ab2a4a6e-be26-4ae7-9f07-c01d98ce2b06 => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:53:32.043220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e0ba438a-2bda-486d-8b01-a78a5eb839fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:32.044175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e0ba438a-2bda-486d-8b01-a78a5eb839fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:32.045685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e0ba438a-2bda-486d-8b01-a78a5eb839fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.218747 Aug 29 21:53:32.046546 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 187/370] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:31 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:32.055977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-30ab64cb-398e-47dc-83bc-7cb2557fc929 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:32.057306 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-30ab64cb-398e-47dc-83bc-7cb2557fc929 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:32.070150 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-30ab64cb-398e-47dc-83bc-7cb2557fc929 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:32.071047 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-30ab64cb-398e-47dc-83bc-7cb2557fc929 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:32.071845 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-30ab64cb-398e-47dc-83bc-7cb2557fc929 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:32.073146 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-30ab64cb-398e-47dc-83bc-7cb2557fc929 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:32.074590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-30ab64cb-398e-47dc-83bc-7cb2557fc929 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:32.076410 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-30ab64cb-398e-47dc-83bc-7cb2557fc929 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:32.342980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e467809e-34c5-4c0c-becd-19f9f5e74ac4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:32.344548 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e467809e-34c5-4c0c-becd-19f9f5e74ac4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:32.357085 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e467809e-34c5-4c0c-becd-19f9f5e74ac4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:32.359301 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e467809e-34c5-4c0c-becd-19f9f5e74ac4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:32.359301 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e467809e-34c5-4c0c-becd-19f9f5e74ac4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:32.361263 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e467809e-34c5-4c0c-becd-19f9f5e74ac4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:32.362267 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e467809e-34c5-4c0c-becd-19f9f5e74ac4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:32.363396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e467809e-34c5-4c0c-becd-19f9f5e74ac4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:32.485974 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-30ab64cb-398e-47dc-83bc-7cb2557fc929 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:32.495557 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-30ab64cb-398e-47dc-83bc-7cb2557fc929 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.455637 Aug 29 21:53:32.496355 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 184/371] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:32 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:32.536032 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e467809e-34c5-4c0c-becd-19f9f5e74ac4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:32.545827 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e467809e-34c5-4c0c-becd-19f9f5e74ac4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.211179 Aug 29 21:53:32.546761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 188/372] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:32 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:32.699405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-773492f5-b7fb-47e9-80cd-87049d9600ff tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:32.701191 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-773492f5-b7fb-47e9-80cd-87049d9600ff tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:32.732901 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-773492f5-b7fb-47e9-80cd-87049d9600ff tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:32.739768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-773492f5-b7fb-47e9-80cd-87049d9600ff tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:32.740690 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-773492f5-b7fb-47e9-80cd-87049d9600ff tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:32.743035 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-773492f5-b7fb-47e9-80cd-87049d9600ff tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:32.748166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-773492f5-b7fb-47e9-80cd-87049d9600ff tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:32.749394 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-773492f5-b7fb-47e9-80cd-87049d9600ff tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:32.850629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2a690d9c-b514-4fd7-ab47-f7eff411d8ae tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:32.853695 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2a690d9c-b514-4fd7-ab47-f7eff411d8ae tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:32.867017 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2a690d9c-b514-4fd7-ab47-f7eff411d8ae tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:32.869608 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2a690d9c-b514-4fd7-ab47-f7eff411d8ae tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:32.872090 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2a690d9c-b514-4fd7-ab47-f7eff411d8ae tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:32.875837 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2a690d9c-b514-4fd7-ab47-f7eff411d8ae tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:32.878091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2a690d9c-b514-4fd7-ab47-f7eff411d8ae tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:32.879144 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2a690d9c-b514-4fd7-ab47-f7eff411d8ae tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:32.994159 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2a690d9c-b514-4fd7-ab47-f7eff411d8ae tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:33.002987 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-773492f5-b7fb-47e9-80cd-87049d9600ff tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:33.014771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-773492f5-b7fb-47e9-80cd-87049d9600ff tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1509 microversion: 2.1 time: 0.323389 Aug 29 21:53:33.030169 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2a690d9c-b514-4fd7-ab47-f7eff411d8ae tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1139 microversion: 2.1 time: 0.174167 Aug 29 21:53:33.030169 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 189/373] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:32 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1139 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:33.033710 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 185/374] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:32 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1509 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:33.059722 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-7b08a033-730c-4170-b9d0-726b082db22d req-cd9ce10b-0f41-46d8-96ed-cba1968cabf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa5570d9-4b51-48eb-a700-7e2aebbbb94e", "tag": "b9d60ca2-d10c-4945-80cb-a5a682f33387"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:33.084325 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-8efa37da-5da1-4504-a3ec-29373634927a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:33.085016 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-8efa37da-5da1-4504-a3ec-29373634927a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:33.103953 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-7b08a033-730c-4170-b9d0-726b082db22d req-cd9ce10b-0f41-46d8-96ed-cba1968cabf8 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:33.106028 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8efa37da-5da1-4504-a3ec-29373634927a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:33.125095 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8efa37da-5da1-4504-a3ec-29373634927a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:33.125095 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8efa37da-5da1-4504-a3ec-29373634927a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:33.125095 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8efa37da-5da1-4504-a3ec-29373634927a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:33.125095 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8efa37da-5da1-4504-a3ec-29373634927a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:33.125416 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8efa37da-5da1-4504-a3ec-29373634927a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:33.125512 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-7b08a033-730c-4170-b9d0-726b082db22d req-cd9ce10b-0f41-46d8-96ed-cba1968cabf8 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:33.125512 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-7b08a033-730c-4170-b9d0-726b082db22d req-cd9ce10b-0f41-46d8-96ed-cba1968cabf8 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:33.140045 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-7b08a033-730c-4170-b9d0-726b082db22d req-cd9ce10b-0f41-46d8-96ed-cba1968cabf8 service nova] Creating event network-changed:b9d60ca2-d10c-4945-80cb-a5a682f33387 for instance fa5570d9-4b51-48eb-a700-7e2aebbbb94e on hv-cinder-85426 Aug 29 21:53:33.146295 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-7b08a033-730c-4170-b9d0-726b082db22d req-cd9ce10b-0f41-46d8-96ed-cba1968cabf8 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090218 Aug 29 21:53:33.147227 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 190/375] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:53:33.360796 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-8efa37da-5da1-4504-a3ec-29373634927a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:33.375100 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-8efa37da-5da1-4504-a3ec-29373634927a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:33.376513 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-8efa37da-5da1-4504-a3ec-29373634927a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:33.377706 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-8efa37da-5da1-4504-a3ec-29373634927a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.300143 Aug 29 21:53:33.378260 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 186/376] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:33 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:53:33.528999 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-410ea183-7002-48ca-a827-532c98c396c9 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:33.529716 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-410ea183-7002-48ca-a827-532c98c396c9 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:33.536303 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-410ea183-7002-48ca-a827-532c98c396c9 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:33.536898 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-410ea183-7002-48ca-a827-532c98c396c9 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:33.537356 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-410ea183-7002-48ca-a827-532c98c396c9 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:33.538104 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-410ea183-7002-48ca-a827-532c98c396c9 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:33.538570 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-410ea183-7002-48ca-a827-532c98c396c9 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:33.539130 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-410ea183-7002-48ca-a827-532c98c396c9 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:33.576699 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-47e29893-4b63-419f-b728-b02fdd42f797 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:33.577638 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-47e29893-4b63-419f-b728-b02fdd42f797 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:33.586443 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-47e29893-4b63-419f-b728-b02fdd42f797 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:33.587159 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-47e29893-4b63-419f-b728-b02fdd42f797 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:33.592452 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-47e29893-4b63-419f-b728-b02fdd42f797 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:33.592452 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-47e29893-4b63-419f-b728-b02fdd42f797 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:33.592452 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-47e29893-4b63-419f-b728-b02fdd42f797 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:33.592452 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-47e29893-4b63-419f-b728-b02fdd42f797 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:33.791623 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-410ea183-7002-48ca-a827-532c98c396c9 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:33.813395 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-410ea183-7002-48ca-a827-532c98c396c9 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.286599 Aug 29 21:53:33.814324 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 191/377] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:33 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:33.900230 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-47e29893-4b63-419f-b728-b02fdd42f797 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:33.909562 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-47e29893-4b63-419f-b728-b02fdd42f797 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.338846 Aug 29 21:53:33.910297 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 187/378] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:33 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:34.048782 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0e3f6586-f7b5-4fd6-84c8-1a8203117b38 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:34.049944 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-0e3f6586-f7b5-4fd6-84c8-1a8203117b38 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:34.053782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6a1cdf29-bb05-45d2-81cc-58a45255f0a6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:34.054829 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6a1cdf29-bb05-45d2-81cc-58a45255f0a6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:34.062625 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0e3f6586-f7b5-4fd6-84c8-1a8203117b38 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:34.063716 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0e3f6586-f7b5-4fd6-84c8-1a8203117b38 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:34.064835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0e3f6586-f7b5-4fd6-84c8-1a8203117b38 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:34.070127 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0e3f6586-f7b5-4fd6-84c8-1a8203117b38 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:34.070127 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0e3f6586-f7b5-4fd6-84c8-1a8203117b38 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:34.070127 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0e3f6586-f7b5-4fd6-84c8-1a8203117b38 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:34.070985 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6a1cdf29-bb05-45d2-81cc-58a45255f0a6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:34.070985 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6a1cdf29-bb05-45d2-81cc-58a45255f0a6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:34.070985 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6a1cdf29-bb05-45d2-81cc-58a45255f0a6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:34.071483 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6a1cdf29-bb05-45d2-81cc-58a45255f0a6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:34.072450 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6a1cdf29-bb05-45d2-81cc-58a45255f0a6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:34.073026 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6a1cdf29-bb05-45d2-81cc-58a45255f0a6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:34.155587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-0e3f6586-f7b5-4fd6-84c8-1a8203117b38 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:34.166397 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-0e3f6586-f7b5-4fd6-84c8-1a8203117b38 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1131 microversion: 2.1 time: 0.128752 Aug 29 21:53:34.181193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 188/379] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:34 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1131 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:34.273942 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6a1cdf29-bb05-45d2-81cc-58a45255f0a6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:34.285279 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6a1cdf29-bb05-45d2-81cc-58a45255f0a6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1509 microversion: 2.1 time: 0.249679 Aug 29 21:53:34.286202 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 192/380] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:34 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1509 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:34.402455 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-09d96827-fc4c-4b86-9926-c4cdd40c7e6f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:34.403165 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-09d96827-fc4c-4b86-9926-c4cdd40c7e6f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:34.410589 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09d96827-fc4c-4b86-9926-c4cdd40c7e6f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:34.411136 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09d96827-fc4c-4b86-9926-c4cdd40c7e6f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:34.411678 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09d96827-fc4c-4b86-9926-c4cdd40c7e6f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:34.412454 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09d96827-fc4c-4b86-9926-c4cdd40c7e6f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:34.413057 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09d96827-fc4c-4b86-9926-c4cdd40c7e6f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:34.413550 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09d96827-fc4c-4b86-9926-c4cdd40c7e6f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:34.654474 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-09d96827-fc4c-4b86-9926-c4cdd40c7e6f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:34.663330 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-09d96827-fc4c-4b86-9926-c4cdd40c7e6f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:34.664860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-09d96827-fc4c-4b86-9926-c4cdd40c7e6f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:34.666095 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-09d96827-fc4c-4b86-9926-c4cdd40c7e6f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.267685 Aug 29 21:53:34.666657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 189/381] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:34 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:34.840161 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-20f87feb-7824-4937-b908-cb397d6c90d6 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:34.840161 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-20f87feb-7824-4937-b908-cb397d6c90d6 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:34.845783 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-20f87feb-7824-4937-b908-cb397d6c90d6 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:34.846281 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-20f87feb-7824-4937-b908-cb397d6c90d6 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:34.846899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-20f87feb-7824-4937-b908-cb397d6c90d6 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:34.848326 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-20f87feb-7824-4937-b908-cb397d6c90d6 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:34.849141 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-20f87feb-7824-4937-b908-cb397d6c90d6 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:34.849863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-20f87feb-7824-4937-b908-cb397d6c90d6 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:34.947332 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-8cfdd254-ecec-4728-9209-db474ea684a4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:34.948318 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-8cfdd254-ecec-4728-9209-db474ea684a4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:34.955035 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cfdd254-ecec-4728-9209-db474ea684a4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:34.955633 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cfdd254-ecec-4728-9209-db474ea684a4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:34.956231 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cfdd254-ecec-4728-9209-db474ea684a4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:34.956970 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cfdd254-ecec-4728-9209-db474ea684a4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:34.957560 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cfdd254-ecec-4728-9209-db474ea684a4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:34.958056 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8cfdd254-ecec-4728-9209-db474ea684a4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:35.044895 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-20f87feb-7824-4937-b908-cb397d6c90d6 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:35.079825 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-20f87feb-7824-4937-b908-cb397d6c90d6 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.243947 Aug 29 21:53:35.086477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 193/382] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:34 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:35.161668 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-8cfdd254-ecec-4728-9209-db474ea684a4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:35.174914 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-8cfdd254-ecec-4728-9209-db474ea684a4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.234238 Aug 29 21:53:35.175966 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 190/383] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:34 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:35.193795 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e555f039-038a-4426-bbbf-095d49a6031f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:35.194422 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e555f039-038a-4426-bbbf-095d49a6031f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:35.201438 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e555f039-038a-4426-bbbf-095d49a6031f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:35.202107 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e555f039-038a-4426-bbbf-095d49a6031f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:35.202550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e555f039-038a-4426-bbbf-095d49a6031f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:35.203267 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e555f039-038a-4426-bbbf-095d49a6031f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:35.203718 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e555f039-038a-4426-bbbf-095d49a6031f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:35.204137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e555f039-038a-4426-bbbf-095d49a6031f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:35.236089 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-bdf24bad-63e7-475d-863d-522974c34016 req-1891479c-d1c8-461f-9aae-63ef3ffecac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f59fdcb-151b-40d2-befd-7114b5ac5c89", "name": "network-vif-plugged", "status": "completed", "tag": "932e39ce-a89d-40b4-8bde-ff728cdabf30"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:35.248358 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-bdf24bad-63e7-475d-863d-522974c34016 req-1891479c-d1c8-461f-9aae-63ef3ffecac3 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:35.248941 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-bdf24bad-63e7-475d-863d-522974c34016 req-1891479c-d1c8-461f-9aae-63ef3ffecac3 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:35.249362 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-bdf24bad-63e7-475d-863d-522974c34016 req-1891479c-d1c8-461f-9aae-63ef3ffecac3 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:35.253827 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:35.270876 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-bdf24bad-63e7-475d-863d-522974c34016 req-1891479c-d1c8-461f-9aae-63ef3ffecac3 service nova] Creating event network-vif-plugged:932e39ce-a89d-40b4-8bde-ff728cdabf30 for instance 3f59fdcb-151b-40d2-befd-7114b5ac5c89 on hv-cinder-85426 Aug 29 21:53:35.276398 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-bdf24bad-63e7-475d-863d-522974c34016 req-1891479c-d1c8-461f-9aae-63ef3ffecac3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044442 Aug 29 21:53:35.277050 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 191/384] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:53:35.287281 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e555f039-038a-4426-bbbf-095d49a6031f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:35.296991 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e555f039-038a-4426-bbbf-095d49a6031f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1131 microversion: 2.1 time: 0.107355 Aug 29 21:53:35.297931 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 194/385] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:35 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1131 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:35.364540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-8f3c3da6-fb2a-45c0-a622-8d48e945d870 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:35.365869 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-8f3c3da6-fb2a-45c0-a622-8d48e945d870 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:35.406007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8f3c3da6-fb2a-45c0-a622-8d48e945d870 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:35.406007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8f3c3da6-fb2a-45c0-a622-8d48e945d870 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:35.406007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8f3c3da6-fb2a-45c0-a622-8d48e945d870 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:35.406007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8f3c3da6-fb2a-45c0-a622-8d48e945d870 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:35.407832 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8f3c3da6-fb2a-45c0-a622-8d48e945d870 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:35.408927 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8f3c3da6-fb2a-45c0-a622-8d48e945d870 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:35.462225 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-dc8f02df-cbdb-42b9-ad35-810ffbe5052f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:35.474977 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dc8f02df-cbdb-42b9-ad35-810ffbe5052f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:35.476941 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dc8f02df-cbdb-42b9-ad35-810ffbe5052f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:35.479297 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dc8f02df-cbdb-42b9-ad35-810ffbe5052f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:35.538895 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-dc8f02df-cbdb-42b9-ad35-810ffbe5052f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Going to try to stop instance {{(pid=127883) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 21:53:35.647577 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-8f3c3da6-fb2a-45c0-a622-8d48e945d870 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:35.657498 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-8f3c3da6-fb2a-45c0-a622-8d48e945d870 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1509 microversion: 2.1 time: 0.312099 Aug 29 21:53:35.658090 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 192/386] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:35 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1509 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:35.688987 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c2a03d11-f315-41a1-bc5c-ac7b06c768be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:35.692570 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c2a03d11-f315-41a1-bc5c-ac7b06c768be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:35.696080 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c2a03d11-f315-41a1-bc5c-ac7b06c768be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:35.696647 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c2a03d11-f315-41a1-bc5c-ac7b06c768be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:35.697085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c2a03d11-f315-41a1-bc5c-ac7b06c768be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:35.697795 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c2a03d11-f315-41a1-bc5c-ac7b06c768be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:35.698251 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c2a03d11-f315-41a1-bc5c-ac7b06c768be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:35.698675 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c2a03d11-f315-41a1-bc5c-ac7b06c768be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:35.772584 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-dc8f02df-cbdb-42b9-ad35-810ffbe5052f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "POST /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/action" status: 202 len: 0 microversion: 2.1 time: 0.316263 Aug 29 21:53:35.778786 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 195/387] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 21:53:35 2022] POST /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:53:35.785457 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e659c0ce-4f19-42a7-9362-12f5f1b74b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:35.786420 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e659c0ce-4f19-42a7-9362-12f5f1b74b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:35.812016 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e659c0ce-4f19-42a7-9362-12f5f1b74b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:35.812840 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e659c0ce-4f19-42a7-9362-12f5f1b74b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:35.815333 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e659c0ce-4f19-42a7-9362-12f5f1b74b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:35.815333 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e659c0ce-4f19-42a7-9362-12f5f1b74b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:35.815333 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e659c0ce-4f19-42a7-9362-12f5f1b74b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:35.824701 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e659c0ce-4f19-42a7-9362-12f5f1b74b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:35.922896 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c2a03d11-f315-41a1-bc5c-ac7b06c768be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:35.936374 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c2a03d11-f315-41a1-bc5c-ac7b06c768be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:35.938186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c2a03d11-f315-41a1-bc5c-ac7b06c768be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:35.939579 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c2a03d11-f315-41a1-bc5c-ac7b06c768be tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1809 microversion: 2.20 time: 0.254625 Aug 29 21:53:35.940561 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 193/388] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:35 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:53:36.026677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e659c0ce-4f19-42a7-9362-12f5f1b74b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:36.035349 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e659c0ce-4f19-42a7-9362-12f5f1b74b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1722 microversion: 2.1 time: 0.255140 Aug 29 21:53:36.036262 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 196/389] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:35 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:36.104737 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-bbd47984-1c62-444b-845c-b6ff11a82af8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:36.105475 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-bbd47984-1c62-444b-845c-b6ff11a82af8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:36.107516 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:36.114975 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bbd47984-1c62-444b-845c-b6ff11a82af8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:36.115471 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bbd47984-1c62-444b-845c-b6ff11a82af8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:36.115910 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bbd47984-1c62-444b-845c-b6ff11a82af8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:36.116653 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bbd47984-1c62-444b-845c-b6ff11a82af8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:36.117331 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bbd47984-1c62-444b-845c-b6ff11a82af8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:36.117820 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bbd47984-1c62-444b-845c-b6ff11a82af8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:36.197782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-3450cb9b-6807-4b71-a779-8c89ddb1fe13 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:36.199361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-3450cb9b-6807-4b71-a779-8c89ddb1fe13 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:36.206714 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3450cb9b-6807-4b71-a779-8c89ddb1fe13 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:36.207204 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3450cb9b-6807-4b71-a779-8c89ddb1fe13 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:36.207651 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3450cb9b-6807-4b71-a779-8c89ddb1fe13 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:36.208345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3450cb9b-6807-4b71-a779-8c89ddb1fe13 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:36.209111 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3450cb9b-6807-4b71-a779-8c89ddb1fe13 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:36.209549 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3450cb9b-6807-4b71-a779-8c89ddb1fe13 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:36.305774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-bbd47984-1c62-444b-845c-b6ff11a82af8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:36.316827 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-bbd47984-1c62-444b-845c-b6ff11a82af8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.216948 Aug 29 21:53:36.317320 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 194/390] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:36 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:36.332950 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-7110e2ae-3811-445b-bf2e-250ffc3c9682 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:36.333646 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-7110e2ae-3811-445b-bf2e-250ffc3c9682 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:36.344907 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7110e2ae-3811-445b-bf2e-250ffc3c9682 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:36.345637 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7110e2ae-3811-445b-bf2e-250ffc3c9682 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:36.346091 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7110e2ae-3811-445b-bf2e-250ffc3c9682 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:36.346926 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7110e2ae-3811-445b-bf2e-250ffc3c9682 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:36.347497 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7110e2ae-3811-445b-bf2e-250ffc3c9682 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:36.348652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7110e2ae-3811-445b-bf2e-250ffc3c9682 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:36.387703 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-3450cb9b-6807-4b71-a779-8c89ddb1fe13 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:36.398448 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-3450cb9b-6807-4b71-a779-8c89ddb1fe13 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.204638 Aug 29 21:53:36.399284 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 197/391] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:36 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:36.416171 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-7110e2ae-3811-445b-bf2e-250ffc3c9682 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:36.424341 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-7110e2ae-3811-445b-bf2e-250ffc3c9682 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1131 microversion: 2.1 time: 0.098191 Aug 29 21:53:36.425045 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 195/392] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:36 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1131 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:36.692916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-cdb4bcba-31db-4496-ae7c-bda1e90a616a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:36.693440 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-cdb4bcba-31db-4496-ae7c-bda1e90a616a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:36.701403 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cdb4bcba-31db-4496-ae7c-bda1e90a616a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:36.701989 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cdb4bcba-31db-4496-ae7c-bda1e90a616a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:36.702435 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cdb4bcba-31db-4496-ae7c-bda1e90a616a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:36.703344 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cdb4bcba-31db-4496-ae7c-bda1e90a616a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:36.703813 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cdb4bcba-31db-4496-ae7c-bda1e90a616a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:36.704308 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cdb4bcba-31db-4496-ae7c-bda1e90a616a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:36.864645 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-cdb4bcba-31db-4496-ae7c-bda1e90a616a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:36.873579 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-cdb4bcba-31db-4496-ae7c-bda1e90a616a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1509 microversion: 2.1 time: 0.184774 Aug 29 21:53:36.874189 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 198/393] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:36 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:36.964607 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-061b212f-112a-4278-9307-9b3ef8226790 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:36.965118 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-061b212f-112a-4278-9307-9b3ef8226790 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:36.973091 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-061b212f-112a-4278-9307-9b3ef8226790 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:36.973584 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-061b212f-112a-4278-9307-9b3ef8226790 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:36.974026 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-061b212f-112a-4278-9307-9b3ef8226790 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:36.974730 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-061b212f-112a-4278-9307-9b3ef8226790 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:36.975187 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-061b212f-112a-4278-9307-9b3ef8226790 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:36.975613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-061b212f-112a-4278-9307-9b3ef8226790 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:37.060510 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f53cbd41-cf46-45c3-a6ae-746cc6305966 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:37.061127 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f53cbd41-cf46-45c3-a6ae-746cc6305966 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:37.067784 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f53cbd41-cf46-45c3-a6ae-746cc6305966 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:37.068303 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f53cbd41-cf46-45c3-a6ae-746cc6305966 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:37.068943 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f53cbd41-cf46-45c3-a6ae-746cc6305966 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:37.069826 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f53cbd41-cf46-45c3-a6ae-746cc6305966 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:37.070311 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f53cbd41-cf46-45c3-a6ae-746cc6305966 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:37.070821 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f53cbd41-cf46-45c3-a6ae-746cc6305966 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:37.129607 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-061b212f-112a-4278-9307-9b3ef8226790 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:37.139244 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-061b212f-112a-4278-9307-9b3ef8226790 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:37.141229 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-061b212f-112a-4278-9307-9b3ef8226790 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:37.142496 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-061b212f-112a-4278-9307-9b3ef8226790 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1796 microversion: 2.20 time: 0.182572 Aug 29 21:53:37.143065 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 196/394] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:53:36 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1796 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:53:37.213713 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f53cbd41-cf46-45c3-a6ae-746cc6305966 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:37.223067 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f53cbd41-cf46-45c3-a6ae-746cc6305966 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1676 microversion: 2.1 time: 0.167686 Aug 29 21:53:37.223874 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 199/395] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:37 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:37.344328 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2a456e17-9769-4e98-9d3e-de67410f2960 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:37.345264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2a456e17-9769-4e98-9d3e-de67410f2960 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:37.351288 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a456e17-9769-4e98-9d3e-de67410f2960 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:37.351776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a456e17-9769-4e98-9d3e-de67410f2960 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:37.352208 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a456e17-9769-4e98-9d3e-de67410f2960 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:37.353029 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a456e17-9769-4e98-9d3e-de67410f2960 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:37.353480 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a456e17-9769-4e98-9d3e-de67410f2960 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:37.353967 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a456e17-9769-4e98-9d3e-de67410f2960 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:37.422051 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e035f6ab-1f55-494c-b1f7-eb62e2f4d0e1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:37.423417 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e035f6ab-1f55-494c-b1f7-eb62e2f4d0e1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:37.434472 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e035f6ab-1f55-494c-b1f7-eb62e2f4d0e1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:37.434988 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e035f6ab-1f55-494c-b1f7-eb62e2f4d0e1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:37.435424 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e035f6ab-1f55-494c-b1f7-eb62e2f4d0e1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:37.436170 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e035f6ab-1f55-494c-b1f7-eb62e2f4d0e1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:37.437206 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e035f6ab-1f55-494c-b1f7-eb62e2f4d0e1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:37.437698 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e035f6ab-1f55-494c-b1f7-eb62e2f4d0e1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:37.460652 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:37.630006 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e035f6ab-1f55-494c-b1f7-eb62e2f4d0e1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:37.638653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e035f6ab-1f55-494c-b1f7-eb62e2f4d0e1 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.223083 Aug 29 21:53:37.639354 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 200/396] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:37 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:37.644231 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-62604942-c8d4-4d9e-828d-cc4a6cc70024 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:37.645220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-62604942-c8d4-4d9e-828d-cc4a6cc70024 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:37.652965 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-62604942-c8d4-4d9e-828d-cc4a6cc70024 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:37.653542 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-62604942-c8d4-4d9e-828d-cc4a6cc70024 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:37.654059 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-62604942-c8d4-4d9e-828d-cc4a6cc70024 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:37.654963 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-62604942-c8d4-4d9e-828d-cc4a6cc70024 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:37.655425 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-62604942-c8d4-4d9e-828d-cc4a6cc70024 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:37.656037 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-62604942-c8d4-4d9e-828d-cc4a6cc70024 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:37.684115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2a456e17-9769-4e98-9d3e-de67410f2960 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:37.692215 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2a456e17-9769-4e98-9d3e-de67410f2960 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.352461 Aug 29 21:53:37.692804 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 197/397] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:37 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:37.737661 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-62604942-c8d4-4d9e-828d-cc4a6cc70024 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:37.746921 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-62604942-c8d4-4d9e-828d-cc4a6cc70024 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1131 microversion: 2.1 time: 0.105926 Aug 29 21:53:37.747668 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 201/398] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:37 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1131 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:37.895174 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c74f9155-3b43-4e7f-99ae-de5b88cda20a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:37.895774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c74f9155-3b43-4e7f-99ae-de5b88cda20a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:37.902246 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c74f9155-3b43-4e7f-99ae-de5b88cda20a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:37.902735 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c74f9155-3b43-4e7f-99ae-de5b88cda20a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:37.903178 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c74f9155-3b43-4e7f-99ae-de5b88cda20a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:37.903879 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c74f9155-3b43-4e7f-99ae-de5b88cda20a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:37.904318 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c74f9155-3b43-4e7f-99ae-de5b88cda20a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:37.904772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c74f9155-3b43-4e7f-99ae-de5b88cda20a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:38.040008 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c74f9155-3b43-4e7f-99ae-de5b88cda20a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:38.049279 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c74f9155-3b43-4e7f-99ae-de5b88cda20a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1515 microversion: 2.1 time: 0.157861 Aug 29 21:53:38.049858 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 198/399] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:37 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:38.252792 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-043575a4-9c62-4a7c-bf27-a0ca661f1d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:38.253986 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-043575a4-9c62-4a7c-bf27-a0ca661f1d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:38.266230 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-043575a4-9c62-4a7c-bf27-a0ca661f1d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:38.267441 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-043575a4-9c62-4a7c-bf27-a0ca661f1d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:38.268251 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-043575a4-9c62-4a7c-bf27-a0ca661f1d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:38.269574 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-043575a4-9c62-4a7c-bf27-a0ca661f1d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:38.270429 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-043575a4-9c62-4a7c-bf27-a0ca661f1d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:38.271216 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-043575a4-9c62-4a7c-bf27-a0ca661f1d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:38.456610 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-043575a4-9c62-4a7c-bf27-a0ca661f1d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:38.469260 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-043575a4-9c62-4a7c-bf27-a0ca661f1d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1676 microversion: 2.1 time: 0.223625 Aug 29 21:53:38.470235 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 202/400] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:38 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:38.659673 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a1e83379-8d00-4513-a348-c01c11362910 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:38.660332 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a1e83379-8d00-4513-a348-c01c11362910 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:38.667018 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a1e83379-8d00-4513-a348-c01c11362910 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:38.668525 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a1e83379-8d00-4513-a348-c01c11362910 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:38.673973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a1e83379-8d00-4513-a348-c01c11362910 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:38.673973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a1e83379-8d00-4513-a348-c01c11362910 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:38.673973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a1e83379-8d00-4513-a348-c01c11362910 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:38.673973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a1e83379-8d00-4513-a348-c01c11362910 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:38.719480 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0d835dfa-c337-4394-b962-beadc82690e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:38.720959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0d835dfa-c337-4394-b962-beadc82690e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:38.731508 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0d835dfa-c337-4394-b962-beadc82690e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:38.732010 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0d835dfa-c337-4394-b962-beadc82690e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:38.732447 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0d835dfa-c337-4394-b962-beadc82690e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:38.733196 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0d835dfa-c337-4394-b962-beadc82690e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:38.733849 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0d835dfa-c337-4394-b962-beadc82690e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:38.734867 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0d835dfa-c337-4394-b962-beadc82690e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:38.890055 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0d835dfa-c337-4394-b962-beadc82690e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:38.898964 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0d835dfa-c337-4394-b962-beadc82690e8 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.188562 Aug 29 21:53:38.900286 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 203/401] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:38 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:38.904475 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a1e83379-8d00-4513-a348-c01c11362910 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:38.912333 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a1e83379-8d00-4513-a348-c01c11362910 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.256887 Aug 29 21:53:38.920951 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 199/402] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:38 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:38.924956 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ebd0b3ca-347b-4dab-b426-cbd83afe670b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:38.925710 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ebd0b3ca-347b-4dab-b426-cbd83afe670b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:38.932063 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ebd0b3ca-347b-4dab-b426-cbd83afe670b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:38.932585 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ebd0b3ca-347b-4dab-b426-cbd83afe670b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:38.933031 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ebd0b3ca-347b-4dab-b426-cbd83afe670b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:38.933782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ebd0b3ca-347b-4dab-b426-cbd83afe670b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:38.934254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ebd0b3ca-347b-4dab-b426-cbd83afe670b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:38.934683 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ebd0b3ca-347b-4dab-b426-cbd83afe670b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:39.001392 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ebd0b3ca-347b-4dab-b426-cbd83afe670b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:39.012530 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ebd0b3ca-347b-4dab-b426-cbd83afe670b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1187 microversion: 2.1 time: 0.098820 Aug 29 21:53:39.013490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 204/403] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:38 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1187 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:39.492336 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4345c1c5-2647-44f2-8674-6780919ae6dd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:39.492989 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4345c1c5-2647-44f2-8674-6780919ae6dd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:39.495439 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=2 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:39.500393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4345c1c5-2647-44f2-8674-6780919ae6dd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:39.500900 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4345c1c5-2647-44f2-8674-6780919ae6dd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:39.501336 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4345c1c5-2647-44f2-8674-6780919ae6dd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:39.502026 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4345c1c5-2647-44f2-8674-6780919ae6dd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:39.502488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4345c1c5-2647-44f2-8674-6780919ae6dd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:39.502909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4345c1c5-2647-44f2-8674-6780919ae6dd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:39.638520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4345c1c5-2647-44f2-8674-6780919ae6dd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:39.647605 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4345c1c5-2647-44f2-8674-6780919ae6dd tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1676 microversion: 2.1 time: 0.159738 Aug 29 21:53:39.648429 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 200/404] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:39 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:39.921155 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-1c5039d0-cbfa-41ae-b7b6-0a6d1ec12e00 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:39.921869 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-1c5039d0-cbfa-41ae-b7b6-0a6d1ec12e00 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:39.929559 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c5039d0-cbfa-41ae-b7b6-0a6d1ec12e00 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:39.937106 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c5039d0-cbfa-41ae-b7b6-0a6d1ec12e00 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:39.937106 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c5039d0-cbfa-41ae-b7b6-0a6d1ec12e00 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:39.937106 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c5039d0-cbfa-41ae-b7b6-0a6d1ec12e00 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:39.937106 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c5039d0-cbfa-41ae-b7b6-0a6d1ec12e00 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:39.937537 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c5039d0-cbfa-41ae-b7b6-0a6d1ec12e00 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:39.942620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5d092ebe-c734-431f-ae23-9b99fd2e9d1e tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:39.943238 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5d092ebe-c734-431f-ae23-9b99fd2e9d1e tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:39.949406 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5d092ebe-c734-431f-ae23-9b99fd2e9d1e tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:39.951019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5d092ebe-c734-431f-ae23-9b99fd2e9d1e tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:39.951473 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5d092ebe-c734-431f-ae23-9b99fd2e9d1e tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:39.952188 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5d092ebe-c734-431f-ae23-9b99fd2e9d1e tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:39.953273 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5d092ebe-c734-431f-ae23-9b99fd2e9d1e tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:39.953942 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5d092ebe-c734-431f-ae23-9b99fd2e9d1e tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:40.100591 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5d092ebe-c734-431f-ae23-9b99fd2e9d1e tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:40.108330 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=8 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:40.121777 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5d092ebe-c734-431f-ae23-9b99fd2e9d1e tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1318 microversion: 2.1 time: 0.182725 Aug 29 21:53:40.122317 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 201/405] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:39 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:40.132646 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-bc2675a6-7d54-48bf-b288-af616fcc1b07 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:40.132646 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-bc2675a6-7d54-48bf-b288-af616fcc1b07 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:40.138681 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-1c5039d0-cbfa-41ae-b7b6-0a6d1ec12e00 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:40.138960 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bc2675a6-7d54-48bf-b288-af616fcc1b07 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:40.139627 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bc2675a6-7d54-48bf-b288-af616fcc1b07 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:40.140261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bc2675a6-7d54-48bf-b288-af616fcc1b07 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:40.141202 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bc2675a6-7d54-48bf-b288-af616fcc1b07 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:40.141886 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bc2675a6-7d54-48bf-b288-af616fcc1b07 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:40.142297 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bc2675a6-7d54-48bf-b288-af616fcc1b07 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:40.147989 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-1c5039d0-cbfa-41ae-b7b6-0a6d1ec12e00 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.230842 Aug 29 21:53:40.148714 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 205/406] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:39 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:40.228605 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ed7fa9b9-ce92-443b-a4be-e54feb674344 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Action: 'create', calling method: .version_select at 0x7f504075bd30>, body: {"keypair": {"name": "tempest-keypair-2011664555", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELchEv5R7LFamWwvLJUIlTnBoeAcRJBvmCva3RPp60oBf8VdyN+3w5aSxru2guC5rtsmLsOchkHqjjkfkK462Z0G/z088SQpZNU25kbyP9GBv5y4NqM0U3oV8CrKcJK7A=="}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:40.233232 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-bc2675a6-7d54-48bf-b288-af616fcc1b07 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:40.241806 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-bc2675a6-7d54-48bf-b288-af616fcc1b07 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1187 microversion: 2.1 time: 0.118430 Aug 29 21:53:40.242772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 202/407] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:40 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1187 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:40.255398 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-ed7fa9b9-ce92-443b-a4be-e54feb674344 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Getting quotas for project f8ca070dc59e4a69bdaca0150f92bcc4. Resources: {'key_pairs'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:53:40.255398 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-ed7fa9b9-ce92-443b-a4be-e54feb674344 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Getting quotas for user 3575098818954a949e202397a1b20a6a and project f8ca070dc59e4a69bdaca0150f92bcc4. Resources: {'key_pairs'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:53:40.265342 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ed7fa9b9-ce92-443b-a4be-e54feb674344 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [7eea145a-a421-4fb6-bd65-92969c7b5fe9] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 21:53:40.670040 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4e7481f8-c14f-4619-b79f-88bb6195f5ae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:40.670921 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4e7481f8-c14f-4619-b79f-88bb6195f5ae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:40.677161 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4e7481f8-c14f-4619-b79f-88bb6195f5ae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:40.677640 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4e7481f8-c14f-4619-b79f-88bb6195f5ae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:40.678069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4e7481f8-c14f-4619-b79f-88bb6195f5ae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:40.678888 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4e7481f8-c14f-4619-b79f-88bb6195f5ae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:40.679339 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4e7481f8-c14f-4619-b79f-88bb6195f5ae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:40.679755 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4e7481f8-c14f-4619-b79f-88bb6195f5ae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:40.815743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4e7481f8-c14f-4619-b79f-88bb6195f5ae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:40.824385 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4e7481f8-c14f-4619-b79f-88bb6195f5ae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1676 microversion: 2.1 time: 0.158312 Aug 29 21:53:40.825195 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 203/408] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:40 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:41.142794 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d585adb5-eab2-4b73-b52e-a0fd9a530543 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:41.143557 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d585adb5-eab2-4b73-b52e-a0fd9a530543 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:41.151290 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d585adb5-eab2-4b73-b52e-a0fd9a530543 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:41.151751 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d585adb5-eab2-4b73-b52e-a0fd9a530543 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:41.152218 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d585adb5-eab2-4b73-b52e-a0fd9a530543 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:41.153725 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d585adb5-eab2-4b73-b52e-a0fd9a530543 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:41.153725 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d585adb5-eab2-4b73-b52e-a0fd9a530543 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:41.154007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d585adb5-eab2-4b73-b52e-a0fd9a530543 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:41.276044 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO oslo.messaging._drivers.impl_rabbit [None req-ed7fa9b9-ce92-443b-a4be-e54feb674344 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [7eea145a-a421-4fb6-bd65-92969c7b5fe9] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 44534. Aug 29 21:53:41.320100 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d585adb5-eab2-4b73-b52e-a0fd9a530543 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:41.333227 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d585adb5-eab2-4b73-b52e-a0fd9a530543 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1507 microversion: 2.1 time: 0.194223 Aug 29 21:53:41.334932 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 204/409] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:41 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:41.341087 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-79a0a262-6c40-41a4-9b51-c42e4919b9b7 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:41.342082 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-79a0a262-6c40-41a4-9b51-c42e4919b9b7 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:41.361218 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-79a0a262-6c40-41a4-9b51-c42e4919b9b7 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:41.364062 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-79a0a262-6c40-41a4-9b51-c42e4919b9b7 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:41.364672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-79a0a262-6c40-41a4-9b51-c42e4919b9b7 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:41.365472 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-79a0a262-6c40-41a4-9b51-c42e4919b9b7 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:41.365967 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-79a0a262-6c40-41a4-9b51-c42e4919b9b7 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:41.366404 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-79a0a262-6c40-41a4-9b51-c42e4919b9b7 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:41.501006 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ed7fa9b9-ce92-443b-a4be-e54feb674344 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.277240 Aug 29 21:53:41.501623 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 206/410] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 21:53:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:53:41.506756 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-560388c5-c0a0-42bb-a11c-c04d23ed91f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:41.508522 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-560388c5-c0a0-42bb-a11c-c04d23ed91f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:41.520503 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-560388c5-c0a0-42bb-a11c-c04d23ed91f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:41.521238 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-560388c5-c0a0-42bb-a11c-c04d23ed91f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:41.522019 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-560388c5-c0a0-42bb-a11c-c04d23ed91f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:41.524613 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-560388c5-c0a0-42bb-a11c-c04d23ed91f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:41.525430 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-560388c5-c0a0-42bb-a11c-c04d23ed91f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:41.526260 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-560388c5-c0a0-42bb-a11c-c04d23ed91f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:41.633326 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-560388c5-c0a0-42bb-a11c-c04d23ed91f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:41.634639 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-79a0a262-6c40-41a4-9b51-c42e4919b9b7 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:41.643853 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-79a0a262-6c40-41a4-9b51-c42e4919b9b7 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.307443 Aug 29 21:53:41.644523 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 205/411] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:41 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:41.663159 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-560388c5-c0a0-42bb-a11c-c04d23ed91f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1187 microversion: 2.1 time: 0.158407 Aug 29 21:53:41.666350 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 207/412] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:41 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1187 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:41.846386 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-85403e77-bbb1-4e66-8899-3df6cba10312 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:41.847015 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-85403e77-bbb1-4e66-8899-3df6cba10312 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:41.854019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-85403e77-bbb1-4e66-8899-3df6cba10312 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:41.854493 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-85403e77-bbb1-4e66-8899-3df6cba10312 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:41.854968 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-85403e77-bbb1-4e66-8899-3df6cba10312 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:41.855824 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-85403e77-bbb1-4e66-8899-3df6cba10312 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:41.856275 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-85403e77-bbb1-4e66-8899-3df6cba10312 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:41.856735 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-85403e77-bbb1-4e66-8899-3df6cba10312 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:42.060025 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-85403e77-bbb1-4e66-8899-3df6cba10312 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:42.072349 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-85403e77-bbb1-4e66-8899-3df6cba10312 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1676 microversion: 2.1 time: 0.229234 Aug 29 21:53:42.084934 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 206/413] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:41 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:42.676228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-effe2bea-9b56-4669-9459-2389004983bc tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:42.677075 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-effe2bea-9b56-4669-9459-2389004983bc tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:42.689265 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-effe2bea-9b56-4669-9459-2389004983bc tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:42.689491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ebe1f965-12eb-410d-a4ec-7092808bf0d9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:42.697300 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-effe2bea-9b56-4669-9459-2389004983bc tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:42.697686 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ebe1f965-12eb-410d-a4ec-7092808bf0d9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:42.697862 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-effe2bea-9b56-4669-9459-2389004983bc tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:42.697862 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-effe2bea-9b56-4669-9459-2389004983bc tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:42.697862 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-effe2bea-9b56-4669-9459-2389004983bc tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:42.697862 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-effe2bea-9b56-4669-9459-2389004983bc tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:42.704550 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebe1f965-12eb-410d-a4ec-7092808bf0d9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:42.705192 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebe1f965-12eb-410d-a4ec-7092808bf0d9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:42.705878 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebe1f965-12eb-410d-a4ec-7092808bf0d9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:42.707967 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebe1f965-12eb-410d-a4ec-7092808bf0d9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:42.708685 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebe1f965-12eb-410d-a4ec-7092808bf0d9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:42.713910 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ebe1f965-12eb-410d-a4ec-7092808bf0d9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:42.862477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ebe1f965-12eb-410d-a4ec-7092808bf0d9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:42.881139 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ebe1f965-12eb-410d-a4ec-7092808bf0d9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1205 microversion: 2.1 time: 0.196253 Aug 29 21:53:42.882953 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 207/414] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:42 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1205 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:43.067769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-effe2bea-9b56-4669-9459-2389004983bc tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:43.083449 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-effe2bea-9b56-4669-9459-2389004983bc tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.421135 Aug 29 21:53:43.099276 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 208/415] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:42 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:43.104449 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4a00af75-ada7-4dd8-be97-a1cde33b83c8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:43.104977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4a00af75-ada7-4dd8-be97-a1cde33b83c8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:43.111962 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4a00af75-ada7-4dd8-be97-a1cde33b83c8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:43.112517 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4a00af75-ada7-4dd8-be97-a1cde33b83c8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:43.112961 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4a00af75-ada7-4dd8-be97-a1cde33b83c8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:43.113669 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4a00af75-ada7-4dd8-be97-a1cde33b83c8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:43.114121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4a00af75-ada7-4dd8-be97-a1cde33b83c8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:43.114547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4a00af75-ada7-4dd8-be97-a1cde33b83c8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:43.133891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=100 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:43.249556 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4a00af75-ada7-4dd8-be97-a1cde33b83c8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:43.257256 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4a00af75-ada7-4dd8-be97-a1cde33b83c8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1676 microversion: 2.1 time: 0.157332 Aug 29 21:53:43.257822 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 208/416] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:43 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:43.930208 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-3fcd4378-3ebd-421a-8028-322ba865c49a tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:43.933104 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-3fcd4378-3ebd-421a-8028-322ba865c49a tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:43.948023 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3fcd4378-3ebd-421a-8028-322ba865c49a tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:43.948721 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3fcd4378-3ebd-421a-8028-322ba865c49a tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:43.949236 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3fcd4378-3ebd-421a-8028-322ba865c49a tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:43.950681 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3fcd4378-3ebd-421a-8028-322ba865c49a tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:43.951226 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3fcd4378-3ebd-421a-8028-322ba865c49a tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:43.951732 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3fcd4378-3ebd-421a-8028-322ba865c49a tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:44.105306 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f21e27e8-dfb3-48a5-b230-16157d7ecc9f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:44.105953 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f21e27e8-dfb3-48a5-b230-16157d7ecc9f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:44.112149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f21e27e8-dfb3-48a5-b230-16157d7ecc9f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:44.112685 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f21e27e8-dfb3-48a5-b230-16157d7ecc9f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:44.113204 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f21e27e8-dfb3-48a5-b230-16157d7ecc9f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:44.113980 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f21e27e8-dfb3-48a5-b230-16157d7ecc9f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:44.114387 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f21e27e8-dfb3-48a5-b230-16157d7ecc9f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:44.115205 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f21e27e8-dfb3-48a5-b230-16157d7ecc9f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:44.153743 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-3fcd4378-3ebd-421a-8028-322ba865c49a tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:44.162688 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-3fcd4378-3ebd-421a-8028-322ba865c49a tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1273 microversion: 2.1 time: 0.239968 Aug 29 21:53:44.163558 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 209/417] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:43 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:44.277965 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ea03969f-669f-41ce-9b9f-ab5fd33ff780 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:44.278629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ea03969f-669f-41ce-9b9f-ab5fd33ff780 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:44.284715 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ea03969f-669f-41ce-9b9f-ab5fd33ff780 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:44.285277 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ea03969f-669f-41ce-9b9f-ab5fd33ff780 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:44.285672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ea03969f-669f-41ce-9b9f-ab5fd33ff780 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:44.286374 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ea03969f-669f-41ce-9b9f-ab5fd33ff780 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:44.286902 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ea03969f-669f-41ce-9b9f-ab5fd33ff780 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:44.287333 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ea03969f-669f-41ce-9b9f-ab5fd33ff780 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:44.346311 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f21e27e8-dfb3-48a5-b230-16157d7ecc9f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:44.355853 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f21e27e8-dfb3-48a5-b230-16157d7ecc9f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.254541 Aug 29 21:53:44.360372 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 209/418] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:44 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:44.427864 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ea03969f-669f-41ce-9b9f-ab5fd33ff780 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:44.437353 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ea03969f-669f-41ce-9b9f-ab5fd33ff780 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1676 microversion: 2.1 time: 0.163063 Aug 29 21:53:44.437964 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 210/419] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:44 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:44.590773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-672080e6-0ef0-40fe-a686-47cc2053962f req-498e7e11-63fe-4340-8423-133b29a6f45a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b90c4eb2-99e9-4c0f-9336-0ecd87390a9f", "tag": "245c7474-204e-46f8-a4ef-735e7fa0f46e"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:44.601951 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-672080e6-0ef0-40fe-a686-47cc2053962f req-498e7e11-63fe-4340-8423-133b29a6f45a service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:44.603422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-672080e6-0ef0-40fe-a686-47cc2053962f req-498e7e11-63fe-4340-8423-133b29a6f45a service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:44.603672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-672080e6-0ef0-40fe-a686-47cc2053962f req-498e7e11-63fe-4340-8423-133b29a6f45a service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:44.617444 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-672080e6-0ef0-40fe-a686-47cc2053962f req-498e7e11-63fe-4340-8423-133b29a6f45a service nova] Creating event network-changed:245c7474-204e-46f8-a4ef-735e7fa0f46e for instance b90c4eb2-99e9-4c0f-9336-0ecd87390a9f on hv-cinder-85426 Aug 29 21:53:44.623748 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-672080e6-0ef0-40fe-a686-47cc2053962f req-498e7e11-63fe-4340-8423-133b29a6f45a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037795 Aug 29 21:53:44.624550 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 210/420] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:53:45.088611 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-701491986", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "networks": [{"uuid": "0f259729-dd6f-4a5d-8cbe-5b49cb092da0"}]}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:45.177637 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.network.neutron [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] validate_networks() for [('0f259729-dd6f-4a5d-8cbe-5b49cb092da0', None, None, None, None, None)] {{(pid=127883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:53:45.185590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5e3eef6e-19b7-4c85-abb6-ca9b232296ba tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:45.187132 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5e3eef6e-19b7-4c85-abb6-ca9b232296ba tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:45.195320 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5e3eef6e-19b7-4c85-abb6-ca9b232296ba tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:45.200723 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5e3eef6e-19b7-4c85-abb6-ca9b232296ba tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:45.202697 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5e3eef6e-19b7-4c85-abb6-ca9b232296ba tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:45.203919 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5e3eef6e-19b7-4c85-abb6-ca9b232296ba tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:45.204617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5e3eef6e-19b7-4c85-abb6-ca9b232296ba tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:45.205405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5e3eef6e-19b7-4c85-abb6-ca9b232296ba tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:45.492449 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5e3eef6e-19b7-4c85-abb6-ca9b232296ba tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:45.507222 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5e3eef6e-19b7-4c85-abb6-ca9b232296ba tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1261 microversion: 2.1 time: 0.325384 Aug 29 21:53:45.508605 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 211/421] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:45 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1261 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:45.517118 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-3d107c47-bd6b-4696-a3bc-c607c171cd4d req-ca751be7-e284-41e3-9cf7-fb30c3b9d809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5570d9-4b51-48eb-a700-7e2aebbbb94e", "name": "network-vif-plugged", "status": "completed", "tag": "b9d60ca2-d10c-4945-80cb-a5a682f33387"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:45.530333 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-3d107c47-bd6b-4696-a3bc-c607c171cd4d req-ca751be7-e284-41e3-9cf7-fb30c3b9d809 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:45.531189 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-3d107c47-bd6b-4696-a3bc-c607c171cd4d req-ca751be7-e284-41e3-9cf7-fb30c3b9d809 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:45.532380 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-3d107c47-bd6b-4696-a3bc-c607c171cd4d req-ca751be7-e284-41e3-9cf7-fb30c3b9d809 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:45.553149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-3d107c47-bd6b-4696-a3bc-c607c171cd4d req-ca751be7-e284-41e3-9cf7-fb30c3b9d809 service nova] Creating event network-vif-plugged:b9d60ca2-d10c-4945-80cb-a5a682f33387 for instance fa5570d9-4b51-48eb-a700-7e2aebbbb94e on hv-cinder-85426 Aug 29 21:53:45.554836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-3d107c47-bd6b-4696-a3bc-c607c171cd4d req-ca751be7-e284-41e3-9cf7-fb30c3b9d809 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043983 Aug 29 21:53:45.556221 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 212/422] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:53:45.561438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f66e2afd-6208-4ad9-a8a3-175fd495eca5 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:45.562154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f66e2afd-6208-4ad9-a8a3-175fd495eca5 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:45.569989 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f66e2afd-6208-4ad9-a8a3-175fd495eca5 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:45.570490 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f66e2afd-6208-4ad9-a8a3-175fd495eca5 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:45.570931 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f66e2afd-6208-4ad9-a8a3-175fd495eca5 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:45.571781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f66e2afd-6208-4ad9-a8a3-175fd495eca5 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:45.572796 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f66e2afd-6208-4ad9-a8a3-175fd495eca5 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:45.573237 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f66e2afd-6208-4ad9-a8a3-175fd495eca5 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:45.833840 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Flavor limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:53:45.833840 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Image limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:53:45.833840 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Flavor pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:53:45.833840 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Image pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:53:45.833840 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:53:45.834832 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:45.834832 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:45.834832 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:45.834832 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:45.835296 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:45.835296 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:45.835484 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f66e2afd-6208-4ad9-a8a3-175fd495eca5 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:45.836214 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Getting quotas for project 914dca3de66e476bb9a73c0e7fe97188. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:53:45.841544 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Getting quotas for user aae8fa0892fe4f37b6ba6b3cf70506a8 and project 914dca3de66e476bb9a73c0e7fe97188. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:53:45.844206 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f66e2afd-6208-4ad9-a8a3-175fd495eca5 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.286783 Aug 29 21:53:45.844912 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 213/423] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:45 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:45.850824 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9a17081f-2978-4aae-a0be-b61a718f7d45 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:45.851783 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9a17081f-2978-4aae-a0be-b61a718f7d45 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:45.860343 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9a17081f-2978-4aae-a0be-b61a718f7d45 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:45.861246 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9a17081f-2978-4aae-a0be-b61a718f7d45 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:45.862132 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9a17081f-2978-4aae-a0be-b61a718f7d45 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:45.863313 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9a17081f-2978-4aae-a0be-b61a718f7d45 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:45.863967 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9a17081f-2978-4aae-a0be-b61a718f7d45 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:45.864627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Going to run 1 instances... {{(pid=127883) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:53:45.864833 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9a17081f-2978-4aae-a0be-b61a718f7d45 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:45.870134 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:53:46.024680 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9a17081f-2978-4aae-a0be-b61a718f7d45 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:46.032700 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9a17081f-2978-4aae-a0be-b61a718f7d45 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1676 microversion: 2.1 time: 0.186261 Aug 29 21:53:46.033277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 214/424] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:45 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:46.038416 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1594483483", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "14f51079-9a2d-46d9-81f3-23979d57f79f"}], "security_groups": [{"name": "tempest-securitygroup--1129071227"}], "key_name": "tempest-keypair-2011664555", "user_data": "}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:46.147915 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.network.neutron [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] validate_networks() for [('14f51079-9a2d-46d9-81f3-23979d57f79f', None, None, None, None, None)] {{(pid=127882) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:53:46.293734 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f5518bf8-3e1f-4eb7-a11b-6323d08f6f3f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.209119 Aug 29 21:53:46.302417 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 211/425] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:53:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:53:46.313303 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-9c1f1707-f8fa-4452-9226-b78411d70e1e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:46.313923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-9c1f1707-f8fa-4452-9226-b78411d70e1e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:46.324159 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:46.380860 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9c1f1707-f8fa-4452-9226-b78411d70e1e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:46.390550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-9c1f1707-f8fa-4452-9226-b78411d70e1e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1213 microversion: 2.1 time: 0.083541 Aug 29 21:53:46.404736 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 212/426] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:46 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:46.537467 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-cac4f919-41e6-4c80-9b4f-77af50997548 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:46.537994 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-cac4f919-41e6-4c80-9b4f-77af50997548 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:46.545792 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cac4f919-41e6-4c80-9b4f-77af50997548 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:46.546280 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cac4f919-41e6-4c80-9b4f-77af50997548 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:46.546713 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cac4f919-41e6-4c80-9b4f-77af50997548 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:46.547412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cac4f919-41e6-4c80-9b4f-77af50997548 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:46.547858 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cac4f919-41e6-4c80-9b4f-77af50997548 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:46.548284 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cac4f919-41e6-4c80-9b4f-77af50997548 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:46.723227 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-cac4f919-41e6-4c80-9b4f-77af50997548 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:46.737642 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-cac4f919-41e6-4c80-9b4f-77af50997548 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1261 microversion: 2.1 time: 0.203809 Aug 29 21:53:46.739416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 213/427] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:46 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1261 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:46.867073 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d8729b34-d56e-489b-abb7-119a268f3b08 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:46.867992 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d8729b34-d56e-489b-abb7-119a268f3b08 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:46.878977 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d8729b34-d56e-489b-abb7-119a268f3b08 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:46.879937 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d8729b34-d56e-489b-abb7-119a268f3b08 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:46.880918 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d8729b34-d56e-489b-abb7-119a268f3b08 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:46.882335 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d8729b34-d56e-489b-abb7-119a268f3b08 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:46.883216 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d8729b34-d56e-489b-abb7-119a268f3b08 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:46.884897 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d8729b34-d56e-489b-abb7-119a268f3b08 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:46.893433 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Flavor limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:53:46.893928 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Image limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:53:46.894264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Flavor pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:53:46.894678 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Image pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:53:46.895094 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:53:46.908862 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:46.910052 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:46.911074 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:46.912050 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:46.912790 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:46.916880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:46.938869 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Getting quotas for project f8ca070dc59e4a69bdaca0150f92bcc4. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:53:46.943036 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Getting quotas for user 3575098818954a949e202397a1b20a6a and project f8ca070dc59e4a69bdaca0150f92bcc4. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:53:46.955144 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Going to run 1 instances... {{(pid=127882) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:53:46.957659 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127882) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:53:47.028215 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d8729b34-d56e-489b-abb7-119a268f3b08 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:47.036933 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d8729b34-d56e-489b-abb7-119a268f3b08 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.174377 Aug 29 21:53:47.042083 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 214/428] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:46 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:47.056185 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7dc3e127-8382-4afc-bbbc-bf19f8daf521 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:47.056783 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7dc3e127-8382-4afc-bbbc-bf19f8daf521 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:47.063741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7dc3e127-8382-4afc-bbbc-bf19f8daf521 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:47.064687 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7dc3e127-8382-4afc-bbbc-bf19f8daf521 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:47.064891 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7dc3e127-8382-4afc-bbbc-bf19f8daf521 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:47.065613 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7dc3e127-8382-4afc-bbbc-bf19f8daf521 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:47.066098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7dc3e127-8382-4afc-bbbc-bf19f8daf521 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:47.066522 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7dc3e127-8382-4afc-bbbc-bf19f8daf521 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:47.175157 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-3e9a5dce-668f-4acf-bd3b-47f9eb2cf28b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.140399 Aug 29 21:53:47.176457 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 215/429] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:53:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:53:47.189138 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-871253aa-7715-4696-a9de-0ec40c71168d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:47.191077 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-871253aa-7715-4696-a9de-0ec40c71168d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:47.227832 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7dc3e127-8382-4afc-bbbc-bf19f8daf521 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:47.236179 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7dc3e127-8382-4afc-bbbc-bf19f8daf521 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1676 microversion: 2.1 time: 0.184786 Aug 29 21:53:47.242569 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 215/430] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:47 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:47.254378 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-871253aa-7715-4696-a9de-0ec40c71168d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:47.261957 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-871253aa-7715-4696-a9de-0ec40c71168d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1246 microversion: 2.1 time: 0.078137 Aug 29 21:53:47.262529 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 216/431] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:47 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1246 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:47.412898 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-850f6fb6-d965-4a10-aa47-5f0ccc457b6f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:47.413620 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-850f6fb6-d965-4a10-aa47-5f0ccc457b6f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:47.466343 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-850f6fb6-d965-4a10-aa47-5f0ccc457b6f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:47.474343 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-850f6fb6-d965-4a10-aa47-5f0ccc457b6f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1213 microversion: 2.1 time: 0.065080 Aug 29 21:53:47.474814 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 216/432] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:47 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:47.760316 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2a07127b-1c80-490b-99eb-b803f48537e9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:47.760976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2a07127b-1c80-490b-99eb-b803f48537e9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:47.767944 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a07127b-1c80-490b-99eb-b803f48537e9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:47.778512 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a07127b-1c80-490b-99eb-b803f48537e9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:47.778512 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a07127b-1c80-490b-99eb-b803f48537e9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:47.778512 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a07127b-1c80-490b-99eb-b803f48537e9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:47.778512 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a07127b-1c80-490b-99eb-b803f48537e9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:47.779128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2a07127b-1c80-490b-99eb-b803f48537e9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:47.917796 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2a07127b-1c80-490b-99eb-b803f48537e9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:47.926016 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2a07127b-1c80-490b-99eb-b803f48537e9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1261 microversion: 2.1 time: 0.170146 Aug 29 21:53:47.926582 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 217/433] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:47 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:48.061064 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7ca3c0f3-ec25-40f4-9752-2fd952b8dc89 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:48.061995 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7ca3c0f3-ec25-40f4-9752-2fd952b8dc89 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:48.070189 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7ca3c0f3-ec25-40f4-9752-2fd952b8dc89 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:48.071941 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7ca3c0f3-ec25-40f4-9752-2fd952b8dc89 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:48.071941 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7ca3c0f3-ec25-40f4-9752-2fd952b8dc89 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:48.072728 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7ca3c0f3-ec25-40f4-9752-2fd952b8dc89 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:48.073186 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7ca3c0f3-ec25-40f4-9752-2fd952b8dc89 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:48.073700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7ca3c0f3-ec25-40f4-9752-2fd952b8dc89 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:48.237863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7ca3c0f3-ec25-40f4-9752-2fd952b8dc89 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:48.246553 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7ca3c0f3-ec25-40f4-9752-2fd952b8dc89 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.191189 Aug 29 21:53:48.259127 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-86812859-ae26-4005-8c84-70c2a79967cb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:48.266908 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-86812859-ae26-4005-8c84-70c2a79967cb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:48.267102 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 217/434] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:48 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:48.267803 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-86812859-ae26-4005-8c84-70c2a79967cb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:48.268299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-86812859-ae26-4005-8c84-70c2a79967cb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:48.268756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-86812859-ae26-4005-8c84-70c2a79967cb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:48.269463 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-86812859-ae26-4005-8c84-70c2a79967cb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:48.269917 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-86812859-ae26-4005-8c84-70c2a79967cb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:48.270346 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-86812859-ae26-4005-8c84-70c2a79967cb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:48.283630 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-80ee4ecd-52b6-485c-9760-dd8218387cd7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:48.284279 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-80ee4ecd-52b6-485c-9760-dd8218387cd7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:48.291359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ee4ecd-52b6-485c-9760-dd8218387cd7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:48.291876 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ee4ecd-52b6-485c-9760-dd8218387cd7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:48.292309 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ee4ecd-52b6-485c-9760-dd8218387cd7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:48.293041 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ee4ecd-52b6-485c-9760-dd8218387cd7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:48.293563 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ee4ecd-52b6-485c-9760-dd8218387cd7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:48.293950 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ee4ecd-52b6-485c-9760-dd8218387cd7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:48.384611 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-80ee4ecd-52b6-485c-9760-dd8218387cd7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:48.398148 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-80ee4ecd-52b6-485c-9760-dd8218387cd7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1250 microversion: 2.1 time: 0.117876 Aug 29 21:53:48.399407 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 218/435] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:48 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1250 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:48.418196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-86812859-ae26-4005-8c84-70c2a79967cb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:48.427655 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-86812859-ae26-4005-8c84-70c2a79967cb tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1653 microversion: 2.1 time: 0.173172 Aug 29 21:53:48.428523 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 218/436] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:48 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1653 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:48.451230 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-338b6e7d-a821-4245-9eda-99969ab56235 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:48.457586 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-338b6e7d-a821-4245-9eda-99969ab56235 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:48.458082 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-338b6e7d-a821-4245-9eda-99969ab56235 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:48.458522 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-338b6e7d-a821-4245-9eda-99969ab56235 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:48.494506 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-338b6e7d-a821-4245-9eda-99969ab56235 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Going to try to start instance {{(pid=127883) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 21:53:48.497693 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a06e2f65-9f4c-45e6-bb31-79dc8ff2c43e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:48.506965 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a06e2f65-9f4c-45e6-bb31-79dc8ff2c43e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:48.515889 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a06e2f65-9f4c-45e6-bb31-79dc8ff2c43e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:48.516393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a06e2f65-9f4c-45e6-bb31-79dc8ff2c43e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:48.516875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a06e2f65-9f4c-45e6-bb31-79dc8ff2c43e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:48.517669 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a06e2f65-9f4c-45e6-bb31-79dc8ff2c43e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:48.519035 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a06e2f65-9f4c-45e6-bb31-79dc8ff2c43e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:48.520441 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a06e2f65-9f4c-45e6-bb31-79dc8ff2c43e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:48.585752 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a06e2f65-9f4c-45e6-bb31-79dc8ff2c43e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:48.597151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a06e2f65-9f4c-45e6-bb31-79dc8ff2c43e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1209 microversion: 2.1 time: 0.104249 Aug 29 21:53:48.598012 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 219/437] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:48 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:48.682950 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:48.809844 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-338b6e7d-a821-4245-9eda-99969ab56235 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "POST /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/action" status: 202 len: 0 microversion: 2.1 time: 0.362907 Aug 29 21:53:48.813545 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 219/438] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 21:53:48 2022] POST /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:53:48.818857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-92ffb3f4-c3be-4db1-9265-d16717631a3d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:48.819494 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-92ffb3f4-c3be-4db1-9265-d16717631a3d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:48.826432 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92ffb3f4-c3be-4db1-9265-d16717631a3d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:48.826987 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92ffb3f4-c3be-4db1-9265-d16717631a3d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:48.827427 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92ffb3f4-c3be-4db1-9265-d16717631a3d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:48.828128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92ffb3f4-c3be-4db1-9265-d16717631a3d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:48.828614 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92ffb3f4-c3be-4db1-9265-d16717631a3d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:48.829039 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92ffb3f4-c3be-4db1-9265-d16717631a3d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:48.954723 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-597feda5-f1bf-4aee-8d23-992f76097c29 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:48.956013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-597feda5-f1bf-4aee-8d23-992f76097c29 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:48.967717 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-597feda5-f1bf-4aee-8d23-992f76097c29 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:48.968468 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-597feda5-f1bf-4aee-8d23-992f76097c29 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:48.969210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-597feda5-f1bf-4aee-8d23-992f76097c29 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:48.973118 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-597feda5-f1bf-4aee-8d23-992f76097c29 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:48.973118 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-597feda5-f1bf-4aee-8d23-992f76097c29 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:48.973118 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-597feda5-f1bf-4aee-8d23-992f76097c29 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:49.001143 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-92ffb3f4-c3be-4db1-9265-d16717631a3d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:49.014316 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-92ffb3f4-c3be-4db1-9265-d16717631a3d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1662 microversion: 2.1 time: 0.199196 Aug 29 21:53:49.030357 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 220/439] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:48 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1662 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:49.162144 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-597feda5-f1bf-4aee-8d23-992f76097c29 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:49.174680 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-597feda5-f1bf-4aee-8d23-992f76097c29 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1261 microversion: 2.1 time: 0.229067 Aug 29 21:53:49.175599 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 220/440] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:48 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1261 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:49.267643 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-bc03aee4-3528-41b7-8afa-57b0adfe085a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:49.268249 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-bc03aee4-3528-41b7-8afa-57b0adfe085a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:49.274850 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bc03aee4-3528-41b7-8afa-57b0adfe085a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:49.275393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bc03aee4-3528-41b7-8afa-57b0adfe085a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:49.275826 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bc03aee4-3528-41b7-8afa-57b0adfe085a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:49.276735 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bc03aee4-3528-41b7-8afa-57b0adfe085a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:49.277197 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bc03aee4-3528-41b7-8afa-57b0adfe085a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:49.277654 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bc03aee4-3528-41b7-8afa-57b0adfe085a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:49.423083 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6141fa9e-d4b2-449a-9e07-4b4e93900877 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:49.424513 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6141fa9e-d4b2-449a-9e07-4b4e93900877 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:49.433254 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-bc03aee4-3528-41b7-8afa-57b0adfe085a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:49.437289 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6141fa9e-d4b2-449a-9e07-4b4e93900877 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:49.438207 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6141fa9e-d4b2-449a-9e07-4b4e93900877 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:49.439101 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6141fa9e-d4b2-449a-9e07-4b4e93900877 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:49.440178 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6141fa9e-d4b2-449a-9e07-4b4e93900877 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:49.440979 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6141fa9e-d4b2-449a-9e07-4b4e93900877 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:49.441776 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6141fa9e-d4b2-449a-9e07-4b4e93900877 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:49.447699 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-bc03aee4-3528-41b7-8afa-57b0adfe085a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.183938 Aug 29 21:53:49.449904 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 221/441] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:49 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:49.519630 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6141fa9e-d4b2-449a-9e07-4b4e93900877 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:49.525699 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6141fa9e-d4b2-449a-9e07-4b4e93900877 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1250 microversion: 2.1 time: 0.110302 Aug 29 21:53:49.526287 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 221/442] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:49 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1250 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:49.621385 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f3b8a9ee-445a-4660-a7b2-6236f6887f58 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:49.622319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f3b8a9ee-445a-4660-a7b2-6236f6887f58 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:49.631873 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f3b8a9ee-445a-4660-a7b2-6236f6887f58 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:49.632411 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f3b8a9ee-445a-4660-a7b2-6236f6887f58 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:49.632901 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f3b8a9ee-445a-4660-a7b2-6236f6887f58 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:49.634184 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f3b8a9ee-445a-4660-a7b2-6236f6887f58 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:49.634727 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f3b8a9ee-445a-4660-a7b2-6236f6887f58 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:49.635156 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f3b8a9ee-445a-4660-a7b2-6236f6887f58 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:49.710435 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f3b8a9ee-445a-4660-a7b2-6236f6887f58 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:49.720127 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f3b8a9ee-445a-4660-a7b2-6236f6887f58 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1265 microversion: 2.1 time: 0.104029 Aug 29 21:53:49.720756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 222/443] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:49 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:50.037627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f9b9729c-360e-47e8-94d4-72c02b3d4d8f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:50.038246 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f9b9729c-360e-47e8-94d4-72c02b3d4d8f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:50.045235 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9b9729c-360e-47e8-94d4-72c02b3d4d8f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:50.046234 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9b9729c-360e-47e8-94d4-72c02b3d4d8f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:50.046636 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9b9729c-360e-47e8-94d4-72c02b3d4d8f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:50.047234 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9b9729c-360e-47e8-94d4-72c02b3d4d8f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:50.047694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9b9729c-360e-47e8-94d4-72c02b3d4d8f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:50.048123 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9b9729c-360e-47e8-94d4-72c02b3d4d8f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:50.205377 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a9abf5f4-26c5-4098-9339-19e47d415ee6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:50.208589 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a9abf5f4-26c5-4098-9339-19e47d415ee6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:50.211124 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f9b9729c-360e-47e8-94d4-72c02b3d4d8f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:50.214833 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a9abf5f4-26c5-4098-9339-19e47d415ee6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:50.215473 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a9abf5f4-26c5-4098-9339-19e47d415ee6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:50.216033 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a9abf5f4-26c5-4098-9339-19e47d415ee6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:50.217462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a9abf5f4-26c5-4098-9339-19e47d415ee6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:50.218062 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a9abf5f4-26c5-4098-9339-19e47d415ee6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:50.218603 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a9abf5f4-26c5-4098-9339-19e47d415ee6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:50.225744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f9b9729c-360e-47e8-94d4-72c02b3d4d8f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1662 microversion: 2.1 time: 0.192390 Aug 29 21:53:50.228072 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 222/444] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:50 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1662 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:50.376203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a9abf5f4-26c5-4098-9339-19e47d415ee6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:50.384811 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a9abf5f4-26c5-4098-9339-19e47d415ee6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1261 microversion: 2.1 time: 0.184749 Aug 29 21:53:50.386149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 223/445] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:50 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:50.476550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-9d5d5dd5-a70a-4dc7-b45f-8fbf4b64799a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:50.476550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-9d5d5dd5-a70a-4dc7-b45f-8fbf4b64799a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:50.483167 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9d5d5dd5-a70a-4dc7-b45f-8fbf4b64799a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:50.483960 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9d5d5dd5-a70a-4dc7-b45f-8fbf4b64799a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:50.484565 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9d5d5dd5-a70a-4dc7-b45f-8fbf4b64799a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:50.486030 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9d5d5dd5-a70a-4dc7-b45f-8fbf4b64799a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:50.486843 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9d5d5dd5-a70a-4dc7-b45f-8fbf4b64799a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:50.487618 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9d5d5dd5-a70a-4dc7-b45f-8fbf4b64799a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:50.547857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4d6e3001-3bf4-49d3-bd30-73874cc77eca tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:50.552598 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4d6e3001-3bf4-49d3-bd30-73874cc77eca tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:50.557146 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4d6e3001-3bf4-49d3-bd30-73874cc77eca tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:50.557902 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4d6e3001-3bf4-49d3-bd30-73874cc77eca tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:50.558726 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4d6e3001-3bf4-49d3-bd30-73874cc77eca tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:50.559665 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4d6e3001-3bf4-49d3-bd30-73874cc77eca tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:50.560131 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4d6e3001-3bf4-49d3-bd30-73874cc77eca tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:50.560595 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4d6e3001-3bf4-49d3-bd30-73874cc77eca tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:50.655529 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4d6e3001-3bf4-49d3-bd30-73874cc77eca tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:50.669076 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4d6e3001-3bf4-49d3-bd30-73874cc77eca tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1242 microversion: 2.1 time: 0.126547 Aug 29 21:53:50.684899 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 224/446] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:50 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1242 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:50.691729 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9d5d5dd5-a70a-4dc7-b45f-8fbf4b64799a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:50.701494 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-9d5d5dd5-a70a-4dc7-b45f-8fbf4b64799a tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1313 microversion: 2.1 time: 0.234579 Aug 29 21:53:50.702836 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 223/447] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:50 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:50.742837 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-fc3bbb0c-b983-4bc5-b9d9-de29ba618e03 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:50.743383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-fc3bbb0c-b983-4bc5-b9d9-de29ba618e03 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:50.749427 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc3bbb0c-b983-4bc5-b9d9-de29ba618e03 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:50.749911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc3bbb0c-b983-4bc5-b9d9-de29ba618e03 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:50.750339 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc3bbb0c-b983-4bc5-b9d9-de29ba618e03 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:50.751069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc3bbb0c-b983-4bc5-b9d9-de29ba618e03 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:50.751523 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc3bbb0c-b983-4bc5-b9d9-de29ba618e03 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:50.751935 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc3bbb0c-b983-4bc5-b9d9-de29ba618e03 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:50.816986 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-fc3bbb0c-b983-4bc5-b9d9-de29ba618e03 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:50.825508 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-fc3bbb0c-b983-4bc5-b9d9-de29ba618e03 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1265 microversion: 2.1 time: 0.086614 Aug 29 21:53:50.826090 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 225/448] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:50 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:51.263928 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b32f8326-509c-497c-bf3e-51dde43f74d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:51.264458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b32f8326-509c-497c-bf3e-51dde43f74d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:51.272146 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b32f8326-509c-497c-bf3e-51dde43f74d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:51.272401 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b32f8326-509c-497c-bf3e-51dde43f74d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:51.273230 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b32f8326-509c-497c-bf3e-51dde43f74d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:51.274182 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b32f8326-509c-497c-bf3e-51dde43f74d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:51.276292 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b32f8326-509c-497c-bf3e-51dde43f74d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:51.277288 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b32f8326-509c-497c-bf3e-51dde43f74d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:51.408474 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4b8644ad-c3ca-4be3-bf0f-2cec264cf2b7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:51.410367 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4b8644ad-c3ca-4be3-bf0f-2cec264cf2b7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:51.429807 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b8644ad-c3ca-4be3-bf0f-2cec264cf2b7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:51.431853 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b8644ad-c3ca-4be3-bf0f-2cec264cf2b7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:51.432672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b8644ad-c3ca-4be3-bf0f-2cec264cf2b7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:51.434757 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b8644ad-c3ca-4be3-bf0f-2cec264cf2b7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:51.435233 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b8644ad-c3ca-4be3-bf0f-2cec264cf2b7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:51.435669 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b8644ad-c3ca-4be3-bf0f-2cec264cf2b7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:51.469055 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b32f8326-509c-497c-bf3e-51dde43f74d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:51.478353 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b32f8326-509c-497c-bf3e-51dde43f74d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1662 microversion: 2.1 time: 0.219115 Aug 29 21:53:51.479606 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 224/449] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:51 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1662 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:51.706104 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-3fba478e-c34d-46d6-924c-ef080d9388aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:51.707216 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-3fba478e-c34d-46d6-924c-ef080d9388aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:51.716458 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4b8644ad-c3ca-4be3-bf0f-2cec264cf2b7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:51.720154 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3fba478e-c34d-46d6-924c-ef080d9388aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:51.720154 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3fba478e-c34d-46d6-924c-ef080d9388aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:51.720154 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3fba478e-c34d-46d6-924c-ef080d9388aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:51.720861 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3fba478e-c34d-46d6-924c-ef080d9388aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:51.721623 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3fba478e-c34d-46d6-924c-ef080d9388aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:51.722237 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3fba478e-c34d-46d6-924c-ef080d9388aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:51.730098 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4b8644ad-c3ca-4be3-bf0f-2cec264cf2b7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1261 microversion: 2.1 time: 0.327110 Aug 29 21:53:51.731365 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 226/450] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:51 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1261 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:51.740519 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2e9c786f-3446-47db-80ff-3c6e9b4f8b22 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:51.742345 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2e9c786f-3446-47db-80ff-3c6e9b4f8b22 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:51.765343 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2e9c786f-3446-47db-80ff-3c6e9b4f8b22 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:51.766391 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2e9c786f-3446-47db-80ff-3c6e9b4f8b22 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:51.766830 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2e9c786f-3446-47db-80ff-3c6e9b4f8b22 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:51.767569 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2e9c786f-3446-47db-80ff-3c6e9b4f8b22 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:51.768030 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2e9c786f-3446-47db-80ff-3c6e9b4f8b22 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:51.768454 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2e9c786f-3446-47db-80ff-3c6e9b4f8b22 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:51.874766 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-3fba478e-c34d-46d6-924c-ef080d9388aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:51.881546 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-3fba478e-c34d-46d6-924c-ef080d9388aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1298 microversion: 2.1 time: 0.182306 Aug 29 21:53:51.884283 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 225/451] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:51 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1298 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:51.890224 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a226bc4c-a5fa-4738-9c22-f18700920806 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:51.891133 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a226bc4c-a5fa-4738-9c22-f18700920806 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:51.901741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a226bc4c-a5fa-4738-9c22-f18700920806 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:51.908636 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a226bc4c-a5fa-4738-9c22-f18700920806 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:51.908636 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a226bc4c-a5fa-4738-9c22-f18700920806 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:51.908636 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a226bc4c-a5fa-4738-9c22-f18700920806 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:51.908636 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a226bc4c-a5fa-4738-9c22-f18700920806 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:51.909285 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a226bc4c-a5fa-4738-9c22-f18700920806 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:52.007342 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a226bc4c-a5fa-4738-9c22-f18700920806 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:52.028912 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a226bc4c-a5fa-4738-9c22-f18700920806 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1273 microversion: 2.1 time: 0.142856 Aug 29 21:53:52.046974 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2e9c786f-3446-47db-80ff-3c6e9b4f8b22 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:52.047334 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 226/452] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:51 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:52.055200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2e9c786f-3446-47db-80ff-3c6e9b4f8b22 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1463 microversion: 2.1 time: 0.322012 Aug 29 21:53:52.056427 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 227/453] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:51 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1463 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:52.115558 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-52a627fa-f862-487f-a11b-37154ddb872f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:52.116690 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-52a627fa-f862-487f-a11b-37154ddb872f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:52.124809 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-52a627fa-f862-487f-a11b-37154ddb872f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:52.125379 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-52a627fa-f862-487f-a11b-37154ddb872f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:52.127411 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-52a627fa-f862-487f-a11b-37154ddb872f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:52.127411 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-52a627fa-f862-487f-a11b-37154ddb872f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:52.127411 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-52a627fa-f862-487f-a11b-37154ddb872f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:52.128187 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-52a627fa-f862-487f-a11b-37154ddb872f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:52.175213 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-52a627fa-f862-487f-a11b-37154ddb872f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Going to try to terminate instance {{(pid=127883) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:53:52.509555 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0c73cd17-9c33-4470-9375-d842effd7565 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:52.510666 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-0c73cd17-9c33-4470-9375-d842effd7565 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:52.521760 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0c73cd17-9c33-4470-9375-d842effd7565 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:52.522495 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0c73cd17-9c33-4470-9375-d842effd7565 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:52.523255 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0c73cd17-9c33-4470-9375-d842effd7565 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:52.525189 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0c73cd17-9c33-4470-9375-d842effd7565 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:52.526089 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0c73cd17-9c33-4470-9375-d842effd7565 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:52.526883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0c73cd17-9c33-4470-9375-d842effd7565 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:52.535430 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=100 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:52.593174 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-52a627fa-f862-487f-a11b-37154ddb872f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "DELETE /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 204 len: 0 microversion: 2.1 time: 0.484710 Aug 29 21:53:52.593876 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 227/454] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:53:52 2022] DELETE /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:53:52.604619 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-aef92e2c-4723-4f4e-b783-b7cbba76647c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:52.605332 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-aef92e2c-4723-4f4e-b783-b7cbba76647c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:52.611668 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-aef92e2c-4723-4f4e-b783-b7cbba76647c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:52.612164 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-aef92e2c-4723-4f4e-b783-b7cbba76647c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:52.612769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-aef92e2c-4723-4f4e-b783-b7cbba76647c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:52.613541 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-aef92e2c-4723-4f4e-b783-b7cbba76647c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:52.614119 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-aef92e2c-4723-4f4e-b783-b7cbba76647c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:52.614552 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-aef92e2c-4723-4f4e-b783-b7cbba76647c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:52.797823 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-0c73cd17-9c33-4470-9375-d842effd7565 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:52.808527 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-0c73cd17-9c33-4470-9375-d842effd7565 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1662 microversion: 2.1 time: 0.304593 Aug 29 21:53:52.809781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 228/455] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:52 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1662 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:52.810083 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-aef92e2c-4723-4f4e-b783-b7cbba76647c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:52.816151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-1db104b8-242b-42f2-86a3-a9a88de76802 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:52.816931 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-1db104b8-242b-42f2-86a3-a9a88de76802 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:52.821653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-aef92e2c-4723-4f4e-b783-b7cbba76647c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1469 microversion: 2.1 time: 0.222058 Aug 29 21:53:52.824921 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 228/456] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:52 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1469 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:52.825698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1db104b8-242b-42f2-86a3-a9a88de76802 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:52.826188 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1db104b8-242b-42f2-86a3-a9a88de76802 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:52.826640 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1db104b8-242b-42f2-86a3-a9a88de76802 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:52.827368 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1db104b8-242b-42f2-86a3-a9a88de76802 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:52.827826 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1db104b8-242b-42f2-86a3-a9a88de76802 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:52.828347 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1db104b8-242b-42f2-86a3-a9a88de76802 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:52.906055 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-29738302-22c2-4270-9e52-41258b672b08 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:52.906704 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-29738302-22c2-4270-9e52-41258b672b08 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:52.913290 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-29738302-22c2-4270-9e52-41258b672b08 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:52.913790 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-29738302-22c2-4270-9e52-41258b672b08 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:52.914232 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-29738302-22c2-4270-9e52-41258b672b08 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:52.914985 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-29738302-22c2-4270-9e52-41258b672b08 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:52.915445 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-29738302-22c2-4270-9e52-41258b672b08 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:52.915876 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-29738302-22c2-4270-9e52-41258b672b08 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:52.986528 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-29738302-22c2-4270-9e52-41258b672b08 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:52.991313 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1db104b8-242b-42f2-86a3-a9a88de76802 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:52.994577 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-29738302-22c2-4270-9e52-41258b672b08 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1306 microversion: 2.1 time: 0.092910 Aug 29 21:53:52.995167 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 229/457] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:52 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1306 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:53.013528 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-1db104b8-242b-42f2-86a3-a9a88de76802 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1261 microversion: 2.1 time: 0.201900 Aug 29 21:53:53.014366 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 229/458] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:52 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:53.065212 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e74761da-966a-4bdc-a00a-71857f54c803 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:53.065830 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e74761da-966a-4bdc-a00a-71857f54c803 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:53.072053 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e74761da-966a-4bdc-a00a-71857f54c803 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:53.072576 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e74761da-966a-4bdc-a00a-71857f54c803 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:53.073071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e74761da-966a-4bdc-a00a-71857f54c803 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:53.073791 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e74761da-966a-4bdc-a00a-71857f54c803 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:53.074256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e74761da-966a-4bdc-a00a-71857f54c803 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:53.074684 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e74761da-966a-4bdc-a00a-71857f54c803 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:53.213210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e74761da-966a-4bdc-a00a-71857f54c803 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:53.221096 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e74761da-966a-4bdc-a00a-71857f54c803 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1313 microversion: 2.1 time: 0.159746 Aug 29 21:53:53.221671 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 230/459] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:53 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:53.703234 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-fbac8e20-4110-4fc8-8c1f-7780bebd12b8 req-6124dbdb-852f-4040-9162-94ded6b0f256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90c4eb2-99e9-4c0f-9336-0ecd87390a9f", "name": "network-vif-plugged", "status": "completed", "tag": "245c7474-204e-46f8-a4ef-735e7fa0f46e"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:53.720889 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-fbac8e20-4110-4fc8-8c1f-7780bebd12b8 req-6124dbdb-852f-4040-9162-94ded6b0f256 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:53.721451 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-fbac8e20-4110-4fc8-8c1f-7780bebd12b8 req-6124dbdb-852f-4040-9162-94ded6b0f256 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:53.722097 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-fbac8e20-4110-4fc8-8c1f-7780bebd12b8 req-6124dbdb-852f-4040-9162-94ded6b0f256 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:53.737197 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-fbac8e20-4110-4fc8-8c1f-7780bebd12b8 req-6124dbdb-852f-4040-9162-94ded6b0f256 service nova] Creating event network-vif-plugged:245c7474-204e-46f8-a4ef-735e7fa0f46e for instance b90c4eb2-99e9-4c0f-9336-0ecd87390a9f on hv-cinder-85426 Aug 29 21:53:53.742377 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-fbac8e20-4110-4fc8-8c1f-7780bebd12b8 req-6124dbdb-852f-4040-9162-94ded6b0f256 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043194 Aug 29 21:53:53.752440 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 230/460] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:53:53.843649 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d7e1c68d-a2f0-4495-b214-a9f145c44779 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:53.844280 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d7e1c68d-a2f0-4495-b214-a9f145c44779 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:53.849609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e6497434-6ccf-4be6-a267-73a0ed49a8a7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:53.850569 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-e6497434-6ccf-4be6-a267-73a0ed49a8a7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:53.856080 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d7e1c68d-a2f0-4495-b214-a9f145c44779 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:53.856656 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d7e1c68d-a2f0-4495-b214-a9f145c44779 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:53.857104 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d7e1c68d-a2f0-4495-b214-a9f145c44779 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:53.857910 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d7e1c68d-a2f0-4495-b214-a9f145c44779 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:53.858368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d7e1c68d-a2f0-4495-b214-a9f145c44779 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:53.859000 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d7e1c68d-a2f0-4495-b214-a9f145c44779 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:53.860670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6497434-6ccf-4be6-a267-73a0ed49a8a7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:53.861177 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6497434-6ccf-4be6-a267-73a0ed49a8a7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:53.861708 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6497434-6ccf-4be6-a267-73a0ed49a8a7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:53.862396 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6497434-6ccf-4be6-a267-73a0ed49a8a7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:53.862920 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6497434-6ccf-4be6-a267-73a0ed49a8a7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:53.863294 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6497434-6ccf-4be6-a267-73a0ed49a8a7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:54.013113 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d7e1c68d-a2f0-4495-b214-a9f145c44779 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:54.024582 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d7e1c68d-a2f0-4495-b214-a9f145c44779 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1469 microversion: 2.1 time: 0.184918 Aug 29 21:53:54.025369 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 231/461] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:53 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:54.029798 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-96db23d0-9fef-414f-b29a-3bcc311ad2ef tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:54.030413 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-96db23d0-9fef-414f-b29a-3bcc311ad2ef tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:54.033964 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e6497434-6ccf-4be6-a267-73a0ed49a8a7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:54.040804 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-96db23d0-9fef-414f-b29a-3bcc311ad2ef tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:54.041506 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-96db23d0-9fef-414f-b29a-3bcc311ad2ef tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:54.042964 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-96db23d0-9fef-414f-b29a-3bcc311ad2ef tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:54.043781 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-96db23d0-9fef-414f-b29a-3bcc311ad2ef tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:54.044462 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-96db23d0-9fef-414f-b29a-3bcc311ad2ef tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:54.045002 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-96db23d0-9fef-414f-b29a-3bcc311ad2ef tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:54.045882 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e6497434-6ccf-4be6-a267-73a0ed49a8a7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1666 microversion: 2.1 time: 0.201033 Aug 29 21:53:54.047103 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 231/462] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:53 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1666 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:54.052369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-1986e2c5-a52c-42d0-a21c-b8cc61f33dd3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:54.053086 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-1986e2c5-a52c-42d0-a21c-b8cc61f33dd3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:54.060176 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1986e2c5-a52c-42d0-a21c-b8cc61f33dd3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:54.060705 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1986e2c5-a52c-42d0-a21c-b8cc61f33dd3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:54.062429 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1986e2c5-a52c-42d0-a21c-b8cc61f33dd3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:54.062429 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1986e2c5-a52c-42d0-a21c-b8cc61f33dd3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:54.062429 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1986e2c5-a52c-42d0-a21c-b8cc61f33dd3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:54.064178 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1986e2c5-a52c-42d0-a21c-b8cc61f33dd3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:54.134659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-96db23d0-9fef-414f-b29a-3bcc311ad2ef tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:54.142671 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-96db23d0-9fef-414f-b29a-3bcc311ad2ef tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1306 microversion: 2.1 time: 0.116432 Aug 29 21:53:54.143364 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 232/463] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:54 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1306 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:54.207836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1986e2c5-a52c-42d0-a21c-b8cc61f33dd3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:54.216340 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-1986e2c5-a52c-42d0-a21c-b8cc61f33dd3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1261 microversion: 2.1 time: 0.167949 Aug 29 21:53:54.216965 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 232/464] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:54 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:54.243881 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a9cbfd31-5961-48f1-8a55-bb3d90d3cae8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:54.244541 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a9cbfd31-5961-48f1-8a55-bb3d90d3cae8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:54.250913 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a9cbfd31-5961-48f1-8a55-bb3d90d3cae8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:54.251410 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a9cbfd31-5961-48f1-8a55-bb3d90d3cae8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:54.251850 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a9cbfd31-5961-48f1-8a55-bb3d90d3cae8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:54.252630 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a9cbfd31-5961-48f1-8a55-bb3d90d3cae8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:54.253145 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a9cbfd31-5961-48f1-8a55-bb3d90d3cae8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:54.253520 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a9cbfd31-5961-48f1-8a55-bb3d90d3cae8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:54.389354 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a9cbfd31-5961-48f1-8a55-bb3d90d3cae8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:54.397857 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a9cbfd31-5961-48f1-8a55-bb3d90d3cae8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1313 microversion: 2.1 time: 0.158425 Aug 29 21:53:54.398446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 233/465] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:54 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:55.059451 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-8a9a9709-ba9e-4966-a1d6-e3d80be6c39c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:55.060324 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-8a9a9709-ba9e-4966-a1d6-e3d80be6c39c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:55.066354 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8a9a9709-ba9e-4966-a1d6-e3d80be6c39c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:55.066836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8a9a9709-ba9e-4966-a1d6-e3d80be6c39c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:55.067267 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8a9a9709-ba9e-4966-a1d6-e3d80be6c39c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:55.068021 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8a9a9709-ba9e-4966-a1d6-e3d80be6c39c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:55.068519 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8a9a9709-ba9e-4966-a1d6-e3d80be6c39c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:55.068925 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8a9a9709-ba9e-4966-a1d6-e3d80be6c39c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:55.162980 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f6e5a019-bef0-4ca8-8b6d-9aaf0f9e4333 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:55.163601 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f6e5a019-bef0-4ca8-8b6d-9aaf0f9e4333 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:55.171002 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f6e5a019-bef0-4ca8-8b6d-9aaf0f9e4333 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:55.171491 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f6e5a019-bef0-4ca8-8b6d-9aaf0f9e4333 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:55.171929 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f6e5a019-bef0-4ca8-8b6d-9aaf0f9e4333 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:55.172656 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f6e5a019-bef0-4ca8-8b6d-9aaf0f9e4333 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:55.173111 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f6e5a019-bef0-4ca8-8b6d-9aaf0f9e4333 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:55.173531 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f6e5a019-bef0-4ca8-8b6d-9aaf0f9e4333 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:55.212637 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-8a9a9709-ba9e-4966-a1d6-e3d80be6c39c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:55.221294 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-8a9a9709-ba9e-4966-a1d6-e3d80be6c39c tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1469 microversion: 2.1 time: 0.166457 Aug 29 21:53:55.222188 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 233/466] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:55 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:55.240058 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-29164c4b-062c-4364-b47b-99d98cc8a2e2 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:55.246134 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-29164c4b-062c-4364-b47b-99d98cc8a2e2 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:55.247368 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-29164c4b-062c-4364-b47b-99d98cc8a2e2 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:55.247868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-29164c4b-062c-4364-b47b-99d98cc8a2e2 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:55.248312 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-29164c4b-062c-4364-b47b-99d98cc8a2e2 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:55.249135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-29164c4b-062c-4364-b47b-99d98cc8a2e2 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:55.249600 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-29164c4b-062c-4364-b47b-99d98cc8a2e2 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:55.250027 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-29164c4b-062c-4364-b47b-99d98cc8a2e2 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:55.259265 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f6e5a019-bef0-4ca8-8b6d-9aaf0f9e4333 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:55.263192 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:55.268045 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f6e5a019-bef0-4ca8-8b6d-9aaf0f9e4333 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1306 microversion: 2.1 time: 0.108758 Aug 29 21:53:55.268681 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 234/467] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:55 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:55.399605 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-29164c4b-062c-4364-b47b-99d98cc8a2e2 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:55.408104 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-29164c4b-062c-4364-b47b-99d98cc8a2e2 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1261 microversion: 2.1 time: 0.172240 Aug 29 21:53:55.412122 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 234/468] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:55 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:55.421062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-273a4883-9f98-48da-935d-2174a5bd0d68 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:55.421982 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-273a4883-9f98-48da-935d-2174a5bd0d68 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:55.428178 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-273a4883-9f98-48da-935d-2174a5bd0d68 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:55.428708 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-273a4883-9f98-48da-935d-2174a5bd0d68 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:55.429150 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-273a4883-9f98-48da-935d-2174a5bd0d68 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:55.429851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-273a4883-9f98-48da-935d-2174a5bd0d68 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:55.430314 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-273a4883-9f98-48da-935d-2174a5bd0d68 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:55.431265 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-273a4883-9f98-48da-935d-2174a5bd0d68 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:55.571261 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-273a4883-9f98-48da-935d-2174a5bd0d68 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:55.580452 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-273a4883-9f98-48da-935d-2174a5bd0d68 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1313 microversion: 2.1 time: 0.164475 Aug 29 21:53:55.581077 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 235/469] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:55 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:56.244554 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ed880bc1-1c19-490c-bb40-e62396eda72f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:56.245128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ed880bc1-1c19-490c-bb40-e62396eda72f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:56.250334 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:56.254795 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed880bc1-1c19-490c-bb40-e62396eda72f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:56.254795 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed880bc1-1c19-490c-bb40-e62396eda72f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:56.254795 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed880bc1-1c19-490c-bb40-e62396eda72f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:56.254795 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed880bc1-1c19-490c-bb40-e62396eda72f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:56.255236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed880bc1-1c19-490c-bb40-e62396eda72f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:56.255664 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed880bc1-1c19-490c-bb40-e62396eda72f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:56.295977 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-63caf11d-85e3-4879-a88b-2d039f4db30d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:56.297115 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-63caf11d-85e3-4879-a88b-2d039f4db30d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:56.304173 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:56.313491 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-63caf11d-85e3-4879-a88b-2d039f4db30d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:56.314011 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-63caf11d-85e3-4879-a88b-2d039f4db30d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:56.314492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-63caf11d-85e3-4879-a88b-2d039f4db30d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:56.315920 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-63caf11d-85e3-4879-a88b-2d039f4db30d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:56.316087 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-63caf11d-85e3-4879-a88b-2d039f4db30d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:56.316543 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-63caf11d-85e3-4879-a88b-2d039f4db30d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:56.487992 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-63caf11d-85e3-4879-a88b-2d039f4db30d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:56.506685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-63caf11d-85e3-4879-a88b-2d039f4db30d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1316 microversion: 2.1 time: 0.216481 Aug 29 21:53:56.507628 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 236/470] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:56 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:56.528834 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-956b44e9-b623-44c2-950b-8b18cae6c7c5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:56.529460 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-956b44e9-b623-44c2-950b-8b18cae6c7c5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:56.540067 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-956b44e9-b623-44c2-950b-8b18cae6c7c5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:56.540593 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-956b44e9-b623-44c2-950b-8b18cae6c7c5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:56.541251 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-956b44e9-b623-44c2-950b-8b18cae6c7c5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:56.542033 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-956b44e9-b623-44c2-950b-8b18cae6c7c5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:56.542516 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-956b44e9-b623-44c2-950b-8b18cae6c7c5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:56.542923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-956b44e9-b623-44c2-950b-8b18cae6c7c5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:56.544872 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ed880bc1-1c19-490c-bb40-e62396eda72f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:56.556675 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ed880bc1-1c19-490c-bb40-e62396eda72f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1469 microversion: 2.1 time: 0.316061 Aug 29 21:53:56.557263 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 235/471] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:56 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1469 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:56.604259 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-21eff9eb-8ff9-4a0b-badb-5988e63949b9 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:56.605393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-21eff9eb-8ff9-4a0b-badb-5988e63949b9 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:56.613131 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-21eff9eb-8ff9-4a0b-badb-5988e63949b9 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:56.613778 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-21eff9eb-8ff9-4a0b-badb-5988e63949b9 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:56.614472 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-21eff9eb-8ff9-4a0b-badb-5988e63949b9 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:56.615484 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-21eff9eb-8ff9-4a0b-badb-5988e63949b9 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:56.616238 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-21eff9eb-8ff9-4a0b-badb-5988e63949b9 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:56.616815 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-21eff9eb-8ff9-4a0b-badb-5988e63949b9 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:56.770524 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-21eff9eb-8ff9-4a0b-badb-5988e63949b9 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:56.781299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-21eff9eb-8ff9-4a0b-badb-5988e63949b9 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1313 microversion: 2.1 time: 0.183228 Aug 29 21:53:56.781963 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 236/472] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:56 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:56.808188 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-cac82990-bcf1-477d-a536-43ba853a5468 req-c81ddce2-eeab-4426-8dd8-d3678f10a447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2f06ae-da11-465b-b76e-0fa88394dc6b", "tag": "d369de3a-f23a-45b4-8b6a-54d8a9594e4a"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:56.818969 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-cac82990-bcf1-477d-a536-43ba853a5468 req-c81ddce2-eeab-4426-8dd8-d3678f10a447 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:56.819528 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-cac82990-bcf1-477d-a536-43ba853a5468 req-c81ddce2-eeab-4426-8dd8-d3678f10a447 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:56.820034 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-cac82990-bcf1-477d-a536-43ba853a5468 req-c81ddce2-eeab-4426-8dd8-d3678f10a447 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:56.833944 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-cac82990-bcf1-477d-a536-43ba853a5468 req-c81ddce2-eeab-4426-8dd8-d3678f10a447 service nova] Creating event network-changed:d369de3a-f23a-45b4-8b6a-54d8a9594e4a for instance 7e2f06ae-da11-465b-b76e-0fa88394dc6b on hv-cinder-85426 Aug 29 21:53:56.842226 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-cac82990-bcf1-477d-a536-43ba853a5468 req-c81ddce2-eeab-4426-8dd8-d3678f10a447 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038539 Aug 29 21:53:56.844395 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 237/473] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:53:56.844560 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-956b44e9-b623-44c2-950b-8b18cae6c7c5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:56.854612 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-956b44e9-b623-44c2-950b-8b18cae6c7c5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1261 microversion: 2.1 time: 0.345579 Aug 29 21:53:56.855375 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 237/474] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:56 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1261 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:57.497128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-996a9698-3433-4d50-a8d4-0e0980ef4650 req-09ea070c-7771-4de7-ac3b-ed13ef7d9b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa5570d9-4b51-48eb-a700-7e2aebbbb94e", "name": "network-vif-deleted", "tag": "b9d60ca2-d10c-4945-80cb-a5a682f33387"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:57.502630 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=2 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:57.505158 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=8 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:57.512543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-996a9698-3433-4d50-a8d4-0e0980ef4650 req-09ea070c-7771-4de7-ac3b-ed13ef7d9b7e service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:57.513041 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-996a9698-3433-4d50-a8d4-0e0980ef4650 req-09ea070c-7771-4de7-ac3b-ed13ef7d9b7e service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:57.513480 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-996a9698-3433-4d50-a8d4-0e0980ef4650 req-09ea070c-7771-4de7-ac3b-ed13ef7d9b7e service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:57.542904 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f1c60c74-6f85-492d-97e1-a9ff826026b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:57.543473 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-996a9698-3433-4d50-a8d4-0e0980ef4650 req-09ea070c-7771-4de7-ac3b-ed13ef7d9b7e service nova] Creating event network-vif-deleted:b9d60ca2-d10c-4945-80cb-a5a682f33387 for instance fa5570d9-4b51-48eb-a700-7e2aebbbb94e on hv-cinder-85426 Aug 29 21:53:57.544373 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f1c60c74-6f85-492d-97e1-a9ff826026b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:57.553530 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-996a9698-3433-4d50-a8d4-0e0980ef4650 req-09ea070c-7771-4de7-ac3b-ed13ef7d9b7e service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060501 Aug 29 21:53:57.556711 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=16 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:57.557525 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 238/475] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:53:57.565240 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f1c60c74-6f85-492d-97e1-a9ff826026b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:57.565742 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f1c60c74-6f85-492d-97e1-a9ff826026b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:57.566380 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f1c60c74-6f85-492d-97e1-a9ff826026b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:57.567280 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f1c60c74-6f85-492d-97e1-a9ff826026b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:57.567919 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f1c60c74-6f85-492d-97e1-a9ff826026b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:57.568560 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f1c60c74-6f85-492d-97e1-a9ff826026b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:57.583609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-60608513-cf44-4a80-aeb9-875550d416ce tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:57.587475 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-60608513-cf44-4a80-aeb9-875550d416ce tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:57.598368 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-60608513-cf44-4a80-aeb9-875550d416ce tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:57.599070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-60608513-cf44-4a80-aeb9-875550d416ce tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:57.599728 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-60608513-cf44-4a80-aeb9-875550d416ce tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:57.600831 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-60608513-cf44-4a80-aeb9-875550d416ce tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:57.601475 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-60608513-cf44-4a80-aeb9-875550d416ce tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:57.602231 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-60608513-cf44-4a80-aeb9-875550d416ce tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:57.679438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-60608513-cf44-4a80-aeb9-875550d416ce tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:57.689938 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-60608513-cf44-4a80-aeb9-875550d416ce tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1427 microversion: 2.1 time: 0.113389 Aug 29 21:53:57.691019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 239/476] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:57 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:57.735653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f1c60c74-6f85-492d-97e1-a9ff826026b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:57.747566 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f1c60c74-6f85-492d-97e1-a9ff826026b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1372 microversion: 2.1 time: 0.207825 Aug 29 21:53:57.748195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 238/477] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:57 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:57.810983 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-02e41783-dbca-4ff5-bce9-f87ecc78f83a tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:57.810983 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-02e41783-dbca-4ff5-bce9-f87ecc78f83a tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:57.810983 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-02e41783-dbca-4ff5-bce9-f87ecc78f83a tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:57.811420 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-02e41783-dbca-4ff5-bce9-f87ecc78f83a tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:57.811565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-02e41783-dbca-4ff5-bce9-f87ecc78f83a tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:57.812272 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-02e41783-dbca-4ff5-bce9-f87ecc78f83a tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:57.812810 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-02e41783-dbca-4ff5-bce9-f87ecc78f83a tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:57.813291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-02e41783-dbca-4ff5-bce9-f87ecc78f83a tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:57.875419 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0aba19b7-1334-418e-a54b-1918617caf4b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:57.876143 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0aba19b7-1334-418e-a54b-1918617caf4b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:57.882473 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0aba19b7-1334-418e-a54b-1918617caf4b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:57.883068 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0aba19b7-1334-418e-a54b-1918617caf4b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:57.883582 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0aba19b7-1334-418e-a54b-1918617caf4b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:57.884413 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0aba19b7-1334-418e-a54b-1918617caf4b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:57.885032 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0aba19b7-1334-418e-a54b-1918617caf4b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:57.885527 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0aba19b7-1334-418e-a54b-1918617caf4b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:58.005511 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-02e41783-dbca-4ff5-bce9-f87ecc78f83a tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:58.020736 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-02e41783-dbca-4ff5-bce9-f87ecc78f83a tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1313 microversion: 2.1 time: 0.221584 Aug 29 21:53:58.035765 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 240/478] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:57 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:58.115662 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0aba19b7-1334-418e-a54b-1918617caf4b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:58.124071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0aba19b7-1334-418e-a54b-1918617caf4b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1261 microversion: 2.1 time: 0.252461 Aug 29 21:53:58.124695 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 239/479] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:57 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1261 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:58.713081 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-abf85375-5ede-4559-b2de-40b8b8aac23d tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:58.713811 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-abf85375-5ede-4559-b2de-40b8b8aac23d tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:58.721454 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-abf85375-5ede-4559-b2de-40b8b8aac23d tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:58.722081 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-abf85375-5ede-4559-b2de-40b8b8aac23d tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:58.722638 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-abf85375-5ede-4559-b2de-40b8b8aac23d tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:58.723349 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-abf85375-5ede-4559-b2de-40b8b8aac23d tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:58.723803 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-abf85375-5ede-4559-b2de-40b8b8aac23d tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:58.724231 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-abf85375-5ede-4559-b2de-40b8b8aac23d tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:58.755895 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-abf85375-5ede-4559-b2de-40b8b8aac23d tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:58.756377 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-abf85375-5ede-4559-b2de-40b8b8aac23d tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:58.756849 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-abf85375-5ede-4559-b2de-40b8b8aac23d tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:58.757290 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-abf85375-5ede-4559-b2de-40b8b8aac23d tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lazy-loading 'fault' on Instance uuid fa5570d9-4b51-48eb-a700-7e2aebbbb94e {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:53:58.768587 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7d02648b-b1bd-42fa-8e1c-29d5d04cae3a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:58.769207 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7d02648b-b1bd-42fa-8e1c-29d5d04cae3a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:58.777408 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7d02648b-b1bd-42fa-8e1c-29d5d04cae3a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:58.782926 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7d02648b-b1bd-42fa-8e1c-29d5d04cae3a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:58.782926 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7d02648b-b1bd-42fa-8e1c-29d5d04cae3a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:58.782926 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7d02648b-b1bd-42fa-8e1c-29d5d04cae3a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:58.782926 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7d02648b-b1bd-42fa-8e1c-29d5d04cae3a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:58.783364 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7d02648b-b1bd-42fa-8e1c-29d5d04cae3a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:58.828605 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-abf85375-5ede-4559-b2de-40b8b8aac23d tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:58.840146 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-abf85375-5ede-4559-b2de-40b8b8aac23d tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1303 microversion: 2.1 time: 0.132387 Aug 29 21:53:58.841563 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 241/480] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:58 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1303 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:58.865791 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-2c86cc5f-aa70-4de3-a40f-19fe3cb190c3 req-d50eda83-eb7e-460f-b247-7ab323ed8af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "945580b2-8dd8-43c7-a485-9501fd158032", "tag": "caed18b7-a71c-45cd-90a8-5ac5f1382523"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:53:58.888466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-2c86cc5f-aa70-4de3-a40f-19fe3cb190c3 req-d50eda83-eb7e-460f-b247-7ab323ed8af4 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:58.889715 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-2c86cc5f-aa70-4de3-a40f-19fe3cb190c3 req-d50eda83-eb7e-460f-b247-7ab323ed8af4 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:58.890532 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-2c86cc5f-aa70-4de3-a40f-19fe3cb190c3 req-d50eda83-eb7e-460f-b247-7ab323ed8af4 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:58.911200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-2c86cc5f-aa70-4de3-a40f-19fe3cb190c3 req-d50eda83-eb7e-460f-b247-7ab323ed8af4 service nova] Creating event network-changed:caed18b7-a71c-45cd-90a8-5ac5f1382523 for instance 945580b2-8dd8-43c7-a485-9501fd158032 on hv-cinder-85426 Aug 29 21:53:58.919756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-2c86cc5f-aa70-4de3-a40f-19fe3cb190c3 req-d50eda83-eb7e-460f-b247-7ab323ed8af4 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058043 Aug 29 21:53:58.920421 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 242/481] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:53:58.929963 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7d02648b-b1bd-42fa-8e1c-29d5d04cae3a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:58.942731 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7d02648b-b1bd-42fa-8e1c-29d5d04cae3a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1372 microversion: 2.1 time: 0.177481 Aug 29 21:53:58.943711 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 240/482] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:58 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:53:59.043504 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4a5cd4ce-4206-42a3-ae89-001b13f7ece8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:59.046369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4a5cd4ce-4206-42a3-ae89-001b13f7ece8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:59.054689 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4a5cd4ce-4206-42a3-ae89-001b13f7ece8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:59.055197 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4a5cd4ce-4206-42a3-ae89-001b13f7ece8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:59.056127 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4a5cd4ce-4206-42a3-ae89-001b13f7ece8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:59.056940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4a5cd4ce-4206-42a3-ae89-001b13f7ece8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:59.057390 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4a5cd4ce-4206-42a3-ae89-001b13f7ece8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:59.057814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4a5cd4ce-4206-42a3-ae89-001b13f7ece8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:59.157550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-92170d5a-cad9-4d7c-8e19-ced9e2d42afa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:59.158409 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-92170d5a-cad9-4d7c-8e19-ced9e2d42afa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:59.165094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92170d5a-cad9-4d7c-8e19-ced9e2d42afa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:59.165739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92170d5a-cad9-4d7c-8e19-ced9e2d42afa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:59.166266 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92170d5a-cad9-4d7c-8e19-ced9e2d42afa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:59.167087 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92170d5a-cad9-4d7c-8e19-ced9e2d42afa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:59.168275 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92170d5a-cad9-4d7c-8e19-ced9e2d42afa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:59.168905 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92170d5a-cad9-4d7c-8e19-ced9e2d42afa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:59.226109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4a5cd4ce-4206-42a3-ae89-001b13f7ece8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:59.235409 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4a5cd4ce-4206-42a3-ae89-001b13f7ece8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1313 microversion: 2.1 time: 0.196327 Aug 29 21:53:59.236014 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 243/483] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:59 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:59.317220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-92170d5a-cad9-4d7c-8e19-ced9e2d42afa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:59.326097 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-92170d5a-cad9-4d7c-8e19-ced9e2d42afa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1446 microversion: 2.1 time: 0.173243 Aug 29 21:53:59.327451 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 241/484] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:59 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1446 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:59.356572 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d4190751-8c01-456f-9edc-d78dac60322f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:59.357435 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d4190751-8c01-456f-9edc-d78dac60322f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:59.363885 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d4190751-8c01-456f-9edc-d78dac60322f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:59.364369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d4190751-8c01-456f-9edc-d78dac60322f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:59.364839 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d4190751-8c01-456f-9edc-d78dac60322f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:59.365532 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d4190751-8c01-456f-9edc-d78dac60322f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:59.365978 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d4190751-8c01-456f-9edc-d78dac60322f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:59.366397 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d4190751-8c01-456f-9edc-d78dac60322f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:59.601550 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d4190751-8c01-456f-9edc-d78dac60322f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:59.610544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d4190751-8c01-456f-9edc-d78dac60322f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1446 microversion: 2.1 time: 0.257719 Aug 29 21:53:59.611228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 244/485] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:59 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1446 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:59.862550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-261e5c8e-e53b-47ac-b69e-d4047113d971 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:59.863264 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-261e5c8e-e53b-47ac-b69e-d4047113d971 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:59.871223 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-261e5c8e-e53b-47ac-b69e-d4047113d971 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:59.871743 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-261e5c8e-e53b-47ac-b69e-d4047113d971 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:59.877661 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-261e5c8e-e53b-47ac-b69e-d4047113d971 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:59.877661 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-261e5c8e-e53b-47ac-b69e-d4047113d971 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:59.877661 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-261e5c8e-e53b-47ac-b69e-d4047113d971 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:59.877661 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-261e5c8e-e53b-47ac-b69e-d4047113d971 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:59.915746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-261e5c8e-e53b-47ac-b69e-d4047113d971 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:59.916281 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-261e5c8e-e53b-47ac-b69e-d4047113d971 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:59.916739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-261e5c8e-e53b-47ac-b69e-d4047113d971 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:59.917229 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-261e5c8e-e53b-47ac-b69e-d4047113d971 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lazy-loading 'fault' on Instance uuid fa5570d9-4b51-48eb-a700-7e2aebbbb94e {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:53:59.962582 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-261e5c8e-e53b-47ac-b69e-d4047113d971 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:53:59.980185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-fd730978-9fb4-4ee7-852b-72fb09a5e627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:53:59.980185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-fd730978-9fb4-4ee7-852b-72fb09a5e627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:53:59.980867 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-261e5c8e-e53b-47ac-b69e-d4047113d971 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1303 microversion: 2.1 time: 0.116654 Aug 29 21:53:59.980867 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 242/486] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:59 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:53:59.981028 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fd730978-9fb4-4ee7-852b-72fb09a5e627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:59.981108 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fd730978-9fb4-4ee7-852b-72fb09a5e627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:59.981500 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fd730978-9fb4-4ee7-852b-72fb09a5e627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:53:59.982245 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fd730978-9fb4-4ee7-852b-72fb09a5e627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:53:59.982721 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fd730978-9fb4-4ee7-852b-72fb09a5e627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:53:59.983155 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fd730978-9fb4-4ee7-852b-72fb09a5e627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:00.157940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-fd730978-9fb4-4ee7-852b-72fb09a5e627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:00.165850 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-fd730978-9fb4-4ee7-852b-72fb09a5e627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1372 microversion: 2.1 time: 0.197368 Aug 29 21:54:00.166455 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 245/487] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:53:59 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1372 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:54:00.256654 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f6525f31-d0e3-4db0-9769-0586268aa903 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:00.257267 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f6525f31-d0e3-4db0-9769-0586268aa903 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:00.264107 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f6525f31-d0e3-4db0-9769-0586268aa903 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:00.264659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f6525f31-d0e3-4db0-9769-0586268aa903 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:00.265094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f6525f31-d0e3-4db0-9769-0586268aa903 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:00.265855 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f6525f31-d0e3-4db0-9769-0586268aa903 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:00.266306 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f6525f31-d0e3-4db0-9769-0586268aa903 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:00.266734 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f6525f31-d0e3-4db0-9769-0586268aa903 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:00.454147 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f6525f31-d0e3-4db0-9769-0586268aa903 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:00.462639 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f6525f31-d0e3-4db0-9769-0586268aa903 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1313 microversion: 2.1 time: 0.209702 Aug 29 21:54:00.469345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 243/488] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:00 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:54:00.998708 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-7bc10ba4-a682-4d5c-865e-3cdbab5a9620 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:00.998708 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-7bc10ba4-a682-4d5c-865e-3cdbab5a9620 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:01.016583 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7bc10ba4-a682-4d5c-865e-3cdbab5a9620 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:01.020767 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7bc10ba4-a682-4d5c-865e-3cdbab5a9620 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:01.021619 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7bc10ba4-a682-4d5c-865e-3cdbab5a9620 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:01.026195 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7bc10ba4-a682-4d5c-865e-3cdbab5a9620 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:01.026195 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7bc10ba4-a682-4d5c-865e-3cdbab5a9620 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:01.026195 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7bc10ba4-a682-4d5c-865e-3cdbab5a9620 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:01.064740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7bc10ba4-a682-4d5c-865e-3cdbab5a9620 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:01.065315 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7bc10ba4-a682-4d5c-865e-3cdbab5a9620 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:01.065806 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7bc10ba4-a682-4d5c-865e-3cdbab5a9620 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:01.066259 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-7bc10ba4-a682-4d5c-865e-3cdbab5a9620 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lazy-loading 'fault' on Instance uuid fa5570d9-4b51-48eb-a700-7e2aebbbb94e {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:54:01.107912 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-7bc10ba4-a682-4d5c-865e-3cdbab5a9620 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:01.111451 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=100 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:01.115993 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-7bc10ba4-a682-4d5c-865e-3cdbab5a9620 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1303 microversion: 2.1 time: 0.122292 Aug 29 21:54:01.116777 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 246/489] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:00 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:01.187292 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f37da0b9-ae5e-431d-81be-291ae12cc921 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:01.187968 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f37da0b9-ae5e-431d-81be-291ae12cc921 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:01.194517 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f37da0b9-ae5e-431d-81be-291ae12cc921 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:01.195050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f37da0b9-ae5e-431d-81be-291ae12cc921 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:01.195529 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f37da0b9-ae5e-431d-81be-291ae12cc921 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:01.196813 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f37da0b9-ae5e-431d-81be-291ae12cc921 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:01.197281 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f37da0b9-ae5e-431d-81be-291ae12cc921 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:01.197776 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f37da0b9-ae5e-431d-81be-291ae12cc921 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:01.414329 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f37da0b9-ae5e-431d-81be-291ae12cc921 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:01.424116 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f37da0b9-ae5e-431d-81be-291ae12cc921 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1372 microversion: 2.1 time: 0.240490 Aug 29 21:54:01.424979 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 244/490] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:01 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1372 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:54:01.483410 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4253f5e9-96a3-4095-bd2c-a531b5242804 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:01.483923 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4253f5e9-96a3-4095-bd2c-a531b5242804 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:01.493254 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4253f5e9-96a3-4095-bd2c-a531b5242804 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:01.493756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4253f5e9-96a3-4095-bd2c-a531b5242804 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:01.494210 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4253f5e9-96a3-4095-bd2c-a531b5242804 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:01.494897 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4253f5e9-96a3-4095-bd2c-a531b5242804 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:01.495607 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4253f5e9-96a3-4095-bd2c-a531b5242804 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:01.495807 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4253f5e9-96a3-4095-bd2c-a531b5242804 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:01.651980 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4253f5e9-96a3-4095-bd2c-a531b5242804 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:01.663867 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4253f5e9-96a3-4095-bd2c-a531b5242804 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1313 microversion: 2.1 time: 0.184347 Aug 29 21:54:01.676518 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 247/491] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:01 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:01.868899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e88c6628-6b59-47ee-a2f4-2922c4636214 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a113fdd6-1fae-452e-89ef-e498da4721d8", "device": "/dev/sdb"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:01.868899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e88c6628-6b59-47ee-a2f4-2922c4636214 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:01.868899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e88c6628-6b59-47ee-a2f4-2922c4636214 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:01.868899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e88c6628-6b59-47ee-a2f4-2922c4636214 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:01.869439 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e88c6628-6b59-47ee-a2f4-2922c4636214 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:01.869439 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e88c6628-6b59-47ee-a2f4-2922c4636214 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:01.869439 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e88c6628-6b59-47ee-a2f4-2922c4636214 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:01.869439 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e88c6628-6b59-47ee-a2f4-2922c4636214 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:02.137855 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6d7c8db2-cac8-40a8-94c4-8febecb66954 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:02.138621 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-6d7c8db2-cac8-40a8-94c4-8febecb66954 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:02.144904 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6d7c8db2-cac8-40a8-94c4-8febecb66954 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:02.145424 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6d7c8db2-cac8-40a8-94c4-8febecb66954 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:02.145866 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6d7c8db2-cac8-40a8-94c4-8febecb66954 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:02.146573 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6d7c8db2-cac8-40a8-94c4-8febecb66954 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:02.147099 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6d7c8db2-cac8-40a8-94c4-8febecb66954 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:02.147548 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6d7c8db2-cac8-40a8-94c4-8febecb66954 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:02.186069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6d7c8db2-cac8-40a8-94c4-8febecb66954 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:02.186562 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6d7c8db2-cac8-40a8-94c4-8febecb66954 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:02.186999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6d7c8db2-cac8-40a8-94c4-8febecb66954 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:02.187449 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-6d7c8db2-cac8-40a8-94c4-8febecb66954 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lazy-loading 'fault' on Instance uuid fa5570d9-4b51-48eb-a700-7e2aebbbb94e {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:54:02.231636 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-6d7c8db2-cac8-40a8-94c4-8febecb66954 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f87b42c88954740914f36c5ea16368f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35e48d292397480b9b3191e957308c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:02.240091 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-6d7c8db2-cac8-40a8-94c4-8febecb66954 tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 200 len: 1303 microversion: 2.1 time: 0.107256 Aug 29 21:54:02.240710 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 248/492] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:02 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:02.449997 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-61b5486d-893a-4ae7-bf32-073895fe6ba7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:02.451182 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-61b5486d-893a-4ae7-bf32-073895fe6ba7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:02.463204 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-61b5486d-893a-4ae7-bf32-073895fe6ba7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:02.464047 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-61b5486d-893a-4ae7-bf32-073895fe6ba7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:02.464861 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-61b5486d-893a-4ae7-bf32-073895fe6ba7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:02.466409 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-61b5486d-893a-4ae7-bf32-073895fe6ba7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:02.467213 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-61b5486d-893a-4ae7-bf32-073895fe6ba7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:02.467953 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-61b5486d-893a-4ae7-bf32-073895fe6ba7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:02.743765 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-61b5486d-893a-4ae7-bf32-073895fe6ba7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:02.767845 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-61b5486d-893a-4ae7-bf32-073895fe6ba7 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1372 microversion: 2.1 time: 0.325785 Aug 29 21:54:02.786565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 249/493] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:02 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1372 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:02.795214 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-aaf57ee8-30a2-4396-bab0-e908dc8ce80a req-2e5f4348-0e5d-4b82-b254-e0231116a3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b90c4eb2-99e9-4c0f-9336-0ecd87390a9f", "tag": "245c7474-204e-46f8-a4ef-735e7fa0f46e"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:02.820788 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-aaf57ee8-30a2-4396-bab0-e908dc8ce80a req-2e5f4348-0e5d-4b82-b254-e0231116a3c0 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:02.821835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-aaf57ee8-30a2-4396-bab0-e908dc8ce80a req-2e5f4348-0e5d-4b82-b254-e0231116a3c0 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:02.825180 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-aaf57ee8-30a2-4396-bab0-e908dc8ce80a req-2e5f4348-0e5d-4b82-b254-e0231116a3c0 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:02.846176 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-aaf57ee8-30a2-4396-bab0-e908dc8ce80a req-2e5f4348-0e5d-4b82-b254-e0231116a3c0 service nova] Creating event network-changed:245c7474-204e-46f8-a4ef-735e7fa0f46e for instance b90c4eb2-99e9-4c0f-9336-0ecd87390a9f on hv-cinder-85426 Aug 29 21:54:02.852262 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-aaf57ee8-30a2-4396-bab0-e908dc8ce80a req-2e5f4348-0e5d-4b82-b254-e0231116a3c0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063983 Aug 29 21:54:02.853037 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 250/494] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:54:02.861907 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-7dddff90-96a3-49f0-ad00-e3868f34323d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:02.862978 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-7dddff90-96a3-49f0-ad00-e3868f34323d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:02.870887 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7dddff90-96a3-49f0-ad00-e3868f34323d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:02.871615 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7dddff90-96a3-49f0-ad00-e3868f34323d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:02.872247 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7dddff90-96a3-49f0-ad00-e3868f34323d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:02.873010 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7dddff90-96a3-49f0-ad00-e3868f34323d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:02.873463 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7dddff90-96a3-49f0-ad00-e3868f34323d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:02.873887 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7dddff90-96a3-49f0-ad00-e3868f34323d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:03.060396 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-7dddff90-96a3-49f0-ad00-e3868f34323d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:03.068891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-7dddff90-96a3-49f0-ad00-e3868f34323d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1313 microversion: 2.1 time: 0.213969 Aug 29 21:54:03.069490 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 251/495] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:02 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:03.261875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2af07370-309e-46a3-a06a-ec28adb4060f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:03.262557 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2af07370-309e-46a3-a06a-ec28adb4060f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] [instance: fa5570d9-4b51-48eb-a700-7e2aebbbb94e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:03.268614 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2af07370-309e-46a3-a06a-ec28adb4060f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:03.269106 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2af07370-309e-46a3-a06a-ec28adb4060f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:03.269640 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2af07370-309e-46a3-a06a-ec28adb4060f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:03.270373 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2af07370-309e-46a3-a06a-ec28adb4060f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:03.270834 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2af07370-309e-46a3-a06a-ec28adb4060f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:03.271262 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2af07370-309e-46a3-a06a-ec28adb4060f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:03.286384 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-2af07370-309e-46a3-a06a-ec28adb4060f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] HTTP exception thrown: Instance fa5570d9-4b51-48eb-a700-7e2aebbbb94e could not be found. Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2af07370-309e-46a3-a06a-ec28adb4060f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Request method failure captured: Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e HTTP/1.1 Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTVDXSWgu2ve3mhQmVu1jyEE8kGoB6Ej3A7BG1xqsofOh7z1TU-e3EFa6QJKNjwUXm_CxMngbjdoaNe11u4-CrQL1QG9ehkP237X5MCIrHhmX_dTd783j5wILusCcbi6CHk4U5Vl5ueGplaV4nzkBvcP7NvVvauSGGdDWEFLKl-Y6g0 Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 35e48d292397480b9b3191e957308c89 Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-VolumesNegativeTest-1013072592 Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:54:03.288024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:54:03.290476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/35e48d292397480b9b3191e957308c89"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_35e48d292397480b9b3191e957308c89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/35e48d292397480b9b3191e957308c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/35e48d292397480b9b3191e957308c89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:54:03.290476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-VolumesNegativeTest-1013072592 Aug 29 21:54:03.290476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 35e48d292397480b9b3191e957308c89 Aug 29 21:54:03.290476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-VolumesNegativeTest-1013072592 Aug 29 21:54:03.290476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-VolumesNegativeTest-1013072592-project Aug 29 21:54:03.290476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:54:03.290476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:54:03.290476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 3f87b42c88954740914f36c5ea16368f Aug 29 21:54:03.290476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-VolumesNegativeTest-1013072592-project Aug 29 21:54:03.290476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:54:03.290476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance fa5570d9-4b51-48eb-a700-7e2aebbbb94e could not be found. Aug 29 21:54:03.290476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': 'fa5570d9-4b51-48eb-a700-7e2aebbbb94e'} Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa5570d9-4b51-48eb-a700-7e2aebbbb94e could not be found. Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:54:03.291342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa5570d9-4b51-48eb-a700-7e2aebbbb94e could not be found. Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa5570d9-4b51-48eb-a700-7e2aebbbb94e could not be found. Aug 29 21:54:03.292676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:54:03.293851 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2af07370-309e-46a3-a06a-ec28adb4060f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] Returning 404 to user: Instance fa5570d9-4b51-48eb-a700-7e2aebbbb94e could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:54:03.293851 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2af07370-309e-46a3-a06a-ec28adb4060f tempest-VolumesNegativeTest-1013072592 tempest-VolumesNegativeTest-1013072592-project] 10.222.0.83 "GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e" status: 404 len: 111 microversion: 2.1 time: 0.031540 Aug 29 21:54:03.293851 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 252/496] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:03 2022] GET /compute/v2.1/servers/fa5570d9-4b51-48eb-a700-7e2aebbbb94e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:54:03.536651 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e88c6628-6b59-47ee-a2f4-2922c4636214 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "POST /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.683478 Aug 29 21:54:03.540789 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 245/497] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 21:54:01 2022] POST /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89/os-volume_attachments => generated 194 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:54:03.791742 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-14fca473-8269-44d6-9c9a-2db36dba30b2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:03.792695 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-14fca473-8269-44d6-9c9a-2db36dba30b2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:03.799695 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14fca473-8269-44d6-9c9a-2db36dba30b2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:03.800336 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14fca473-8269-44d6-9c9a-2db36dba30b2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:03.800887 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14fca473-8269-44d6-9c9a-2db36dba30b2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:03.801660 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14fca473-8269-44d6-9c9a-2db36dba30b2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:03.802223 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14fca473-8269-44d6-9c9a-2db36dba30b2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:03.802718 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-14fca473-8269-44d6-9c9a-2db36dba30b2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:03.949852 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-14fca473-8269-44d6-9c9a-2db36dba30b2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:03.958278 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-14fca473-8269-44d6-9c9a-2db36dba30b2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1372 microversion: 2.1 time: 0.171082 Aug 29 21:54:03.959105 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 253/498] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:03 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:04.091922 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-52769bc4-1584-47e5-bf89-7712e0b78e9b tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:04.092759 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-52769bc4-1584-47e5-bf89-7712e0b78e9b tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:04.099246 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-52769bc4-1584-47e5-bf89-7712e0b78e9b tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:04.099732 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-52769bc4-1584-47e5-bf89-7712e0b78e9b tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:04.100165 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-52769bc4-1584-47e5-bf89-7712e0b78e9b tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:04.100944 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-52769bc4-1584-47e5-bf89-7712e0b78e9b tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:04.101403 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-52769bc4-1584-47e5-bf89-7712e0b78e9b tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:04.108635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-52769bc4-1584-47e5-bf89-7712e0b78e9b tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:04.259256 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-b3e3c23e-d376-42e7-be8d-1599c58996a0 req-0bc7bce7-59fe-454a-bc2e-312886e1e39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2f06ae-da11-465b-b76e-0fa88394dc6b", "name": "network-vif-plugged", "status": "completed", "tag": "d369de3a-f23a-45b4-8b6a-54d8a9594e4a"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:04.282950 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-b3e3c23e-d376-42e7-be8d-1599c58996a0 req-0bc7bce7-59fe-454a-bc2e-312886e1e39a service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:04.283580 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-b3e3c23e-d376-42e7-be8d-1599c58996a0 req-0bc7bce7-59fe-454a-bc2e-312886e1e39a service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:04.293869 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-b3e3c23e-d376-42e7-be8d-1599c58996a0 req-0bc7bce7-59fe-454a-bc2e-312886e1e39a service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:04.308714 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-b3e3c23e-d376-42e7-be8d-1599c58996a0 req-0bc7bce7-59fe-454a-bc2e-312886e1e39a service nova] Creating event network-vif-plugged:d369de3a-f23a-45b4-8b6a-54d8a9594e4a for instance 7e2f06ae-da11-465b-b76e-0fa88394dc6b on hv-cinder-85426 Aug 29 21:54:04.315477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-b3e3c23e-d376-42e7-be8d-1599c58996a0 req-0bc7bce7-59fe-454a-bc2e-312886e1e39a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059030 Aug 29 21:54:04.315477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 254/499] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:54:04.492274 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-52769bc4-1584-47e5-bf89-7712e0b78e9b tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:04.504306 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-52769bc4-1584-47e5-bf89-7712e0b78e9b tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1313 microversion: 2.1 time: 0.417504 Aug 29 21:54:04.504950 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 246/500] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:04 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:04.979727 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-3d291c48-26b4-49dd-9d5c-397e51d65910 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:04.980460 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3d291c48-26b4-49dd-9d5c-397e51d65910 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:04.994687 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3d291c48-26b4-49dd-9d5c-397e51d65910 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:05.000264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3d291c48-26b4-49dd-9d5c-397e51d65910 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:05.000264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3d291c48-26b4-49dd-9d5c-397e51d65910 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:05.000264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3d291c48-26b4-49dd-9d5c-397e51d65910 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:05.000264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3d291c48-26b4-49dd-9d5c-397e51d65910 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:05.000860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3d291c48-26b4-49dd-9d5c-397e51d65910 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:05.147141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-3d291c48-26b4-49dd-9d5c-397e51d65910 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:05.156509 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-3d291c48-26b4-49dd-9d5c-397e51d65910 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1372 microversion: 2.1 time: 0.180832 Aug 29 21:54:05.157099 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 255/501] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:04 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:05.532435 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d9d2da93-30b4-41aa-a2f0-16e6092d39ae tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:05.532435 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d9d2da93-30b4-41aa-a2f0-16e6092d39ae tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:05.533748 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d9d2da93-30b4-41aa-a2f0-16e6092d39ae tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:05.534239 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d9d2da93-30b4-41aa-a2f0-16e6092d39ae tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:05.534672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d9d2da93-30b4-41aa-a2f0-16e6092d39ae tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:05.535371 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d9d2da93-30b4-41aa-a2f0-16e6092d39ae tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:05.535833 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d9d2da93-30b4-41aa-a2f0-16e6092d39ae tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:05.536254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d9d2da93-30b4-41aa-a2f0-16e6092d39ae tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:05.671872 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d9d2da93-30b4-41aa-a2f0-16e6092d39ae tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:05.679719 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d9d2da93-30b4-41aa-a2f0-16e6092d39ae tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1313 microversion: 2.1 time: 0.157809 Aug 29 21:54:05.680893 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 247/502] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:05 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:06.178200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-3a6a37f9-e36c-4f1c-a9e5-04c714e47bb0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:06.178839 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3a6a37f9-e36c-4f1c-a9e5-04c714e47bb0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:06.185762 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a6a37f9-e36c-4f1c-a9e5-04c714e47bb0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:06.186296 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a6a37f9-e36c-4f1c-a9e5-04c714e47bb0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:06.186770 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a6a37f9-e36c-4f1c-a9e5-04c714e47bb0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:06.188400 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a6a37f9-e36c-4f1c-a9e5-04c714e47bb0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:06.188400 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a6a37f9-e36c-4f1c-a9e5-04c714e47bb0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:06.188400 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a6a37f9-e36c-4f1c-a9e5-04c714e47bb0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:06.336314 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-3a6a37f9-e36c-4f1c-a9e5-04c714e47bb0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:06.344393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-3a6a37f9-e36c-4f1c-a9e5-04c714e47bb0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1372 microversion: 2.1 time: 0.170528 Aug 29 21:54:06.345140 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 256/503] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:06 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:06.701749 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-53f1f2b1-c2a1-491a-bd37-11a2747e52fa tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:06.702350 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-53f1f2b1-c2a1-491a-bd37-11a2747e52fa tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:06.709183 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-53f1f2b1-c2a1-491a-bd37-11a2747e52fa tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:06.709669 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-53f1f2b1-c2a1-491a-bd37-11a2747e52fa tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:06.710103 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-53f1f2b1-c2a1-491a-bd37-11a2747e52fa tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:06.710804 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-53f1f2b1-c2a1-491a-bd37-11a2747e52fa tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:06.711285 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-53f1f2b1-c2a1-491a-bd37-11a2747e52fa tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:06.712363 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-53f1f2b1-c2a1-491a-bd37-11a2747e52fa tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:06.871318 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-53f1f2b1-c2a1-491a-bd37-11a2747e52fa tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:06.879363 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-53f1f2b1-c2a1-491a-bd37-11a2747e52fa tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1313 microversion: 2.1 time: 0.181468 Aug 29 21:54:06.879946 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 248/504] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:06 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:07.382988 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6e87647e-3017-469f-884f-27752abd9e68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:07.384325 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-6e87647e-3017-469f-884f-27752abd9e68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:07.390388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6e87647e-3017-469f-884f-27752abd9e68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:07.390868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6e87647e-3017-469f-884f-27752abd9e68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:07.391300 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6e87647e-3017-469f-884f-27752abd9e68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:07.391986 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6e87647e-3017-469f-884f-27752abd9e68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:07.392432 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6e87647e-3017-469f-884f-27752abd9e68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:07.392926 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6e87647e-3017-469f-884f-27752abd9e68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:07.534793 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-6e87647e-3017-469f-884f-27752abd9e68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:07.542925 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-6e87647e-3017-469f-884f-27752abd9e68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1372 microversion: 2.1 time: 0.164072 Aug 29 21:54:07.543760 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 257/505] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:07 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:07.901795 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-c1b00db2-85f7-4cab-af90-216c3c1dc46d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:07.913053 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-c1b00db2-85f7-4cab-af90-216c3c1dc46d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:07.913053 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c1b00db2-85f7-4cab-af90-216c3c1dc46d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:07.913053 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c1b00db2-85f7-4cab-af90-216c3c1dc46d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:07.913326 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c1b00db2-85f7-4cab-af90-216c3c1dc46d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:07.913786 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c1b00db2-85f7-4cab-af90-216c3c1dc46d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:07.914260 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c1b00db2-85f7-4cab-af90-216c3c1dc46d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:07.914682 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c1b00db2-85f7-4cab-af90-216c3c1dc46d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:08.057079 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-c1b00db2-85f7-4cab-af90-216c3c1dc46d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:08.061986 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:08.068692 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-c1b00db2-85f7-4cab-af90-216c3c1dc46d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1497 microversion: 2.1 time: 0.169732 Aug 29 21:54:08.068692 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 249/506] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:07 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:08.355229 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-f139ccf1-b91a-45f6-8064-543936acd90b req-85410d2b-9af5-427e-91c8-6f343e03120a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "945580b2-8dd8-43c7-a485-9501fd158032", "name": "network-vif-plugged", "status": "completed", "tag": "caed18b7-a71c-45cd-90a8-5ac5f1382523"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:08.365726 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-f139ccf1-b91a-45f6-8064-543936acd90b req-85410d2b-9af5-427e-91c8-6f343e03120a service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:08.366214 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-f139ccf1-b91a-45f6-8064-543936acd90b req-85410d2b-9af5-427e-91c8-6f343e03120a service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:08.366650 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-f139ccf1-b91a-45f6-8064-543936acd90b req-85410d2b-9af5-427e-91c8-6f343e03120a service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:08.379525 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-f139ccf1-b91a-45f6-8064-543936acd90b req-85410d2b-9af5-427e-91c8-6f343e03120a service nova] Creating event network-vif-plugged:caed18b7-a71c-45cd-90a8-5ac5f1382523 for instance 945580b2-8dd8-43c7-a485-9501fd158032 on hv-cinder-85426 Aug 29 21:54:08.385261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-f139ccf1-b91a-45f6-8064-543936acd90b req-85410d2b-9af5-427e-91c8-6f343e03120a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033887 Aug 29 21:54:08.385909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 258/507] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:54:08.563213 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-77c2d304-edab-4927-a75f-79bb42c6603e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:08.563840 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-77c2d304-edab-4927-a75f-79bb42c6603e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:08.572357 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-77c2d304-edab-4927-a75f-79bb42c6603e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:08.572893 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-77c2d304-edab-4927-a75f-79bb42c6603e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:08.576071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-77c2d304-edab-4927-a75f-79bb42c6603e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:08.576071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-77c2d304-edab-4927-a75f-79bb42c6603e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:08.576071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-77c2d304-edab-4927-a75f-79bb42c6603e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:08.576071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-77c2d304-edab-4927-a75f-79bb42c6603e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:08.721567 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-77c2d304-edab-4927-a75f-79bb42c6603e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:08.730750 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-77c2d304-edab-4927-a75f-79bb42c6603e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1372 microversion: 2.1 time: 0.171245 Aug 29 21:54:08.732017 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 250/508] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:08 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:09.359954 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f7105927-1cf0-4a76-867c-9becb4f67613 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:09.359954 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f7105927-1cf0-4a76-867c-9becb4f67613 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:09.381842 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f7105927-1cf0-4a76-867c-9becb4f67613 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:09.381842 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f7105927-1cf0-4a76-867c-9becb4f67613 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:09.381842 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f7105927-1cf0-4a76-867c-9becb4f67613 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:09.381842 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f7105927-1cf0-4a76-867c-9becb4f67613 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:09.382147 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f7105927-1cf0-4a76-867c-9becb4f67613 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:09.382147 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f7105927-1cf0-4a76-867c-9becb4f67613 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:09.397271 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f7105927-1cf0-4a76-867c-9becb4f67613 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Going to try to terminate instance {{(pid=127882) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:54:09.751753 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-da0ba2c8-a8a0-46f4-8543-f25e5c6cd0d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:09.752365 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-da0ba2c8-a8a0-46f4-8543-f25e5c6cd0d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:09.760157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-da0ba2c8-a8a0-46f4-8543-f25e5c6cd0d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:09.764626 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-da0ba2c8-a8a0-46f4-8543-f25e5c6cd0d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:09.764626 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-da0ba2c8-a8a0-46f4-8543-f25e5c6cd0d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:09.764626 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-da0ba2c8-a8a0-46f4-8543-f25e5c6cd0d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:09.764626 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-da0ba2c8-a8a0-46f4-8543-f25e5c6cd0d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:09.765203 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-da0ba2c8-a8a0-46f4-8543-f25e5c6cd0d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:09.841704 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f7105927-1cf0-4a76-867c-9becb4f67613 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "DELETE /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 204 len: 0 microversion: 2.1 time: 0.489107 Aug 29 21:54:09.842298 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 259/509] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:54:09 2022] DELETE /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:54:09.851195 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4822e9d8-57aa-40b8-be01-aae4f1f2d3b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:09.851892 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4822e9d8-57aa-40b8-be01-aae4f1f2d3b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:09.858280 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4822e9d8-57aa-40b8-be01-aae4f1f2d3b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:09.858761 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4822e9d8-57aa-40b8-be01-aae4f1f2d3b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:09.859191 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4822e9d8-57aa-40b8-be01-aae4f1f2d3b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:09.859876 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4822e9d8-57aa-40b8-be01-aae4f1f2d3b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:09.860318 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4822e9d8-57aa-40b8-be01-aae4f1f2d3b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:09.860780 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4822e9d8-57aa-40b8-be01-aae4f1f2d3b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:09.930543 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-da0ba2c8-a8a0-46f4-8543-f25e5c6cd0d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:09.944438 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-da0ba2c8-a8a0-46f4-8543-f25e5c6cd0d0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1372 microversion: 2.1 time: 0.196426 Aug 29 21:54:09.945067 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 251/510] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:09 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1372 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:54:10.058626 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4822e9d8-57aa-40b8-be01-aae4f1f2d3b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:10.069485 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4822e9d8-57aa-40b8-be01-aae4f1f2d3b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1503 microversion: 2.1 time: 0.222078 Aug 29 21:54:10.070094 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 260/511] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:09 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1503 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:54:10.971344 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7185f472-dfde-42f0-862c-8431e186a80d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:10.972143 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7185f472-dfde-42f0-862c-8431e186a80d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:10.979820 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7185f472-dfde-42f0-862c-8431e186a80d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:10.980284 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7185f472-dfde-42f0-862c-8431e186a80d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:10.980759 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7185f472-dfde-42f0-862c-8431e186a80d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:10.981456 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7185f472-dfde-42f0-862c-8431e186a80d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:10.981903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7185f472-dfde-42f0-862c-8431e186a80d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:10.982438 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7185f472-dfde-42f0-862c-8431e186a80d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:11.093370 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-38389d5b-6509-42d2-9117-aa7c680fc03f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:11.093930 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-38389d5b-6509-42d2-9117-aa7c680fc03f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:11.100179 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-38389d5b-6509-42d2-9117-aa7c680fc03f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:11.100707 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-38389d5b-6509-42d2-9117-aa7c680fc03f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:11.101388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-38389d5b-6509-42d2-9117-aa7c680fc03f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:11.102392 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-38389d5b-6509-42d2-9117-aa7c680fc03f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:11.102994 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-38389d5b-6509-42d2-9117-aa7c680fc03f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:11.103587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-38389d5b-6509-42d2-9117-aa7c680fc03f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:11.136210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7185f472-dfde-42f0-862c-8431e186a80d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:11.145384 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7185f472-dfde-42f0-862c-8431e186a80d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1372 microversion: 2.1 time: 0.178329 Aug 29 21:54:11.149449 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 252/512] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:10 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:11.265466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-38389d5b-6509-42d2-9117-aa7c680fc03f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:11.274810 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-38389d5b-6509-42d2-9117-aa7c680fc03f tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1503 microversion: 2.1 time: 0.185665 Aug 29 21:54:11.288853 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 261/513] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:11 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:11.294848 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-73d7a3d2-c543-4cc1-b008-3fb78ffbc4e4 req-cfe7d673-234a-4586-8107-04b151b3b32d admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "a113fdd6-1fae-452e-89ef-e498da4721d8", "create_info": {"type": "qcow2", "new_file": "volume-a113fdd6-1fae-452e-89ef-e498da4721d8.715303fa-f5cc-42bc-915a-75cdbc3743cc.vhdx", "snapshot_id": "715303fa-f5cc-42bc-915a-75cdbc3743cc"}}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:11.304425 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [req-73d7a3d2-c543-4cc1-b008-3fb78ffbc4e4 req-cfe7d673-234a-4586-8107-04b151b3b32d admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f4124b42-2c45-4eaf-83bf-04e147b24cbe(cell1) {{(pid=127883) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 29 21:54:11.304915 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-73d7a3d2-c543-4cc1-b008-3fb78ffbc4e4 req-cfe7d673-234a-4586-8107-04b151b3b32d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:11.305598 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-73d7a3d2-c543-4cc1-b008-3fb78ffbc4e4 req-cfe7d673-234a-4586-8107-04b151b3b32d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:11.305949 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-73d7a3d2-c543-4cc1-b008-3fb78ffbc4e4 req-cfe7d673-234a-4586-8107-04b151b3b32d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:11.346818 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-73d7a3d2-c543-4cc1-b008-3fb78ffbc4e4 req-cfe7d673-234a-4586-8107-04b151b3b32d admin admin] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:11.347229 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-73d7a3d2-c543-4cc1-b008-3fb78ffbc4e4 req-cfe7d673-234a-4586-8107-04b151b3b32d admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:11.347657 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-73d7a3d2-c543-4cc1-b008-3fb78ffbc4e4 req-cfe7d673-234a-4586-8107-04b151b3b32d admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:11.373390 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-73d7a3d2-c543-4cc1-b008-3fb78ffbc4e4 req-cfe7d673-234a-4586-8107-04b151b3b32d admin admin] 10.222.0.121 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.212764 Aug 29 21:54:11.374000 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 253/514] 10.222.0.121 () {64 vars in 1327 bytes} [Mon Aug 29 21:54:11 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:54:12.167544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-229d042a-8d4b-4bc7-881b-6acde658a313 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:12.168199 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-229d042a-8d4b-4bc7-881b-6acde658a313 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:12.174790 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-229d042a-8d4b-4bc7-881b-6acde658a313 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:12.175299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-229d042a-8d4b-4bc7-881b-6acde658a313 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:12.175766 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-229d042a-8d4b-4bc7-881b-6acde658a313 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:12.176780 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-229d042a-8d4b-4bc7-881b-6acde658a313 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:12.177024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-229d042a-8d4b-4bc7-881b-6acde658a313 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:12.177448 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-229d042a-8d4b-4bc7-881b-6acde658a313 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:12.297370 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e5d7f835-f079-4c93-8f7d-d29c98f55aa0 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:12.298880 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e5d7f835-f079-4c93-8f7d-d29c98f55aa0 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:12.306460 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5d7f835-f079-4c93-8f7d-d29c98f55aa0 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:12.306948 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5d7f835-f079-4c93-8f7d-d29c98f55aa0 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:12.307387 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5d7f835-f079-4c93-8f7d-d29c98f55aa0 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:12.308113 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5d7f835-f079-4c93-8f7d-d29c98f55aa0 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:12.308599 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5d7f835-f079-4c93-8f7d-d29c98f55aa0 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:12.309023 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5d7f835-f079-4c93-8f7d-d29c98f55aa0 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:12.333187 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-229d042a-8d4b-4bc7-881b-6acde658a313 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:12.343068 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-229d042a-8d4b-4bc7-881b-6acde658a313 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1372 microversion: 2.1 time: 0.179372 Aug 29 21:54:12.344252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 262/515] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:12 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:12.456155 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e5d7f835-f079-4c93-8f7d-d29c98f55aa0 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:12.465185 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e5d7f835-f079-4c93-8f7d-d29c98f55aa0 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1503 microversion: 2.1 time: 0.172992 Aug 29 21:54:12.465752 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 254/516] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:12 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:13.375699 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a087f697-2530-4d1d-9859-60606cc4f0e1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:13.376962 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a087f697-2530-4d1d-9859-60606cc4f0e1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:13.383507 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a087f697-2530-4d1d-9859-60606cc4f0e1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:13.384055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a087f697-2530-4d1d-9859-60606cc4f0e1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:13.384573 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a087f697-2530-4d1d-9859-60606cc4f0e1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:13.385328 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a087f697-2530-4d1d-9859-60606cc4f0e1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:13.385840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a087f697-2530-4d1d-9859-60606cc4f0e1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:13.386336 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a087f697-2530-4d1d-9859-60606cc4f0e1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:13.489244 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0e5e11ab-ebfe-47e4-953d-705dd0fe8dfc tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:13.489956 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0e5e11ab-ebfe-47e4-953d-705dd0fe8dfc tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:13.499801 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0e5e11ab-ebfe-47e4-953d-705dd0fe8dfc tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:13.500308 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0e5e11ab-ebfe-47e4-953d-705dd0fe8dfc tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:13.500806 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0e5e11ab-ebfe-47e4-953d-705dd0fe8dfc tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:13.501791 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0e5e11ab-ebfe-47e4-953d-705dd0fe8dfc tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:13.502258 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0e5e11ab-ebfe-47e4-953d-705dd0fe8dfc tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:13.502693 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0e5e11ab-ebfe-47e4-953d-705dd0fe8dfc tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:13.552842 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a087f697-2530-4d1d-9859-60606cc4f0e1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:13.552842 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a087f697-2530-4d1d-9859-60606cc4f0e1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1565 microversion: 2.1 time: 0.176904 Aug 29 21:54:13.552842 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 263/517] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:13 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:13.569557 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-40b33b00-2a50-4472-8a3a-ae4ec38b45db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:13.570102 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-40b33b00-2a50-4472-8a3a-ae4ec38b45db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:13.576854 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-40b33b00-2a50-4472-8a3a-ae4ec38b45db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:13.577355 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-40b33b00-2a50-4472-8a3a-ae4ec38b45db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:13.577948 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-40b33b00-2a50-4472-8a3a-ae4ec38b45db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:13.583857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-40b33b00-2a50-4472-8a3a-ae4ec38b45db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:13.583857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-40b33b00-2a50-4472-8a3a-ae4ec38b45db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:13.583857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-40b33b00-2a50-4472-8a3a-ae4ec38b45db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:13.584139 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:13.668706 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-40b33b00-2a50-4472-8a3a-ae4ec38b45db tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102900 Aug 29 21:54:13.669454 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 264/518] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 21:54:13 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:54:13.732658 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0e5e11ab-ebfe-47e4-953d-705dd0fe8dfc tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:13.743643 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0e5e11ab-ebfe-47e4-953d-705dd0fe8dfc tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1503 microversion: 2.1 time: 0.258808 Aug 29 21:54:13.744298 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 255/519] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:13 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:14.766574 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-df0a385e-2aae-4ad7-b677-b41c5805a96d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:14.767205 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-df0a385e-2aae-4ad7-b677-b41c5805a96d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:14.774189 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-df0a385e-2aae-4ad7-b677-b41c5805a96d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:14.774692 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-df0a385e-2aae-4ad7-b677-b41c5805a96d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:14.775138 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-df0a385e-2aae-4ad7-b677-b41c5805a96d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:14.775911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-df0a385e-2aae-4ad7-b677-b41c5805a96d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:14.776370 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-df0a385e-2aae-4ad7-b677-b41c5805a96d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:14.776832 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-df0a385e-2aae-4ad7-b677-b41c5805a96d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:14.859056 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-6db85145-3b4f-43e1-b852-f99aeb7c68e7 req-fa933fd2-5ca8-4cec-a9d1-275d42edd921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "945580b2-8dd8-43c7-a485-9501fd158032", "tag": "caed18b7-a71c-45cd-90a8-5ac5f1382523"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:14.876900 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-6db85145-3b4f-43e1-b852-f99aeb7c68e7 req-fa933fd2-5ca8-4cec-a9d1-275d42edd921 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:14.877035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-6db85145-3b4f-43e1-b852-f99aeb7c68e7 req-fa933fd2-5ca8-4cec-a9d1-275d42edd921 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:14.877376 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-6db85145-3b4f-43e1-b852-f99aeb7c68e7 req-fa933fd2-5ca8-4cec-a9d1-275d42edd921 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:14.892800 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-6db85145-3b4f-43e1-b852-f99aeb7c68e7 req-fa933fd2-5ca8-4cec-a9d1-275d42edd921 service nova] Creating event network-changed:caed18b7-a71c-45cd-90a8-5ac5f1382523 for instance 945580b2-8dd8-43c7-a485-9501fd158032 on hv-cinder-85426 Aug 29 21:54:14.898599 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-6db85145-3b4f-43e1-b852-f99aeb7c68e7 req-fa933fd2-5ca8-4cec-a9d1-275d42edd921 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047785 Aug 29 21:54:14.899503 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 256/520] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:54:15.048227 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-df0a385e-2aae-4ad7-b677-b41c5805a96d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:15.058926 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-df0a385e-2aae-4ad7-b677-b41c5805a96d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1503 microversion: 2.1 time: 0.297063 Aug 29 21:54:15.059677 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 265/521] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:14 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:16.082938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d53d381d-5cd7-47aa-ab9f-4105ac46c5a4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:16.085050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d53d381d-5cd7-47aa-ab9f-4105ac46c5a4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:16.088848 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:16.094608 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d53d381d-5cd7-47aa-ab9f-4105ac46c5a4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:16.095100 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d53d381d-5cd7-47aa-ab9f-4105ac46c5a4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:16.095541 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d53d381d-5cd7-47aa-ab9f-4105ac46c5a4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:16.096274 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d53d381d-5cd7-47aa-ab9f-4105ac46c5a4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:16.096931 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d53d381d-5cd7-47aa-ab9f-4105ac46c5a4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:16.097360 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d53d381d-5cd7-47aa-ab9f-4105ac46c5a4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:16.252129 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d53d381d-5cd7-47aa-ab9f-4105ac46c5a4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:16.280776 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d53d381d-5cd7-47aa-ab9f-4105ac46c5a4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1298 microversion: 2.1 time: 0.203310 Aug 29 21:54:16.287569 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 257/522] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:16 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1298 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:16.922177 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-395ddd1d-de64-4fbf-8eab-9a86ab36e7e2 req-1d7bf8be-08ea-4c95-9c07-5a4118533f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2f06ae-da11-465b-b76e-0fa88394dc6b", "name": "network-vif-deleted", "tag": "d369de3a-f23a-45b4-8b6a-54d8a9594e4a"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:16.932639 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-395ddd1d-de64-4fbf-8eab-9a86ab36e7e2 req-1d7bf8be-08ea-4c95-9c07-5a4118533f48 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:16.933115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-395ddd1d-de64-4fbf-8eab-9a86ab36e7e2 req-1d7bf8be-08ea-4c95-9c07-5a4118533f48 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:16.933541 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-395ddd1d-de64-4fbf-8eab-9a86ab36e7e2 req-1d7bf8be-08ea-4c95-9c07-5a4118533f48 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:16.945403 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-395ddd1d-de64-4fbf-8eab-9a86ab36e7e2 req-1d7bf8be-08ea-4c95-9c07-5a4118533f48 service nova] Creating event network-vif-deleted:d369de3a-f23a-45b4-8b6a-54d8a9594e4a for instance 7e2f06ae-da11-465b-b76e-0fa88394dc6b on hv-cinder-85426 Aug 29 21:54:16.950463 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-395ddd1d-de64-4fbf-8eab-9a86ab36e7e2 req-1d7bf8be-08ea-4c95-9c07-5a4118533f48 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032233 Aug 29 21:54:16.951253 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 266/523] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:54:17.308822 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e429e56c-28eb-43aa-bc4c-28a5a5673720 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:17.309766 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e429e56c-28eb-43aa-bc4c-28a5a5673720 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:17.316303 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e429e56c-28eb-43aa-bc4c-28a5a5673720 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:17.316823 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e429e56c-28eb-43aa-bc4c-28a5a5673720 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:17.317556 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e429e56c-28eb-43aa-bc4c-28a5a5673720 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:17.318477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e429e56c-28eb-43aa-bc4c-28a5a5673720 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:17.318939 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e429e56c-28eb-43aa-bc4c-28a5a5673720 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:17.319373 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e429e56c-28eb-43aa-bc4c-28a5a5673720 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:17.365204 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e429e56c-28eb-43aa-bc4c-28a5a5673720 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:17.365987 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e429e56c-28eb-43aa-bc4c-28a5a5673720 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:17.367070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e429e56c-28eb-43aa-bc4c-28a5a5673720 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:17.367745 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-e429e56c-28eb-43aa-bc4c-28a5a5673720 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lazy-loading 'fault' on Instance uuid 7e2f06ae-da11-465b-b76e-0fa88394dc6b {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:54:17.426019 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e429e56c-28eb-43aa-bc4c-28a5a5673720 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:17.441123 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e429e56c-28eb-43aa-bc4c-28a5a5673720 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 200 len: 1303 microversion: 2.1 time: 0.136824 Aug 29 21:54:17.442426 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 258/524] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:17 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 1303 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:18.475435 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d89dcda5-3095-4cd8-af18-5e0b7782a89e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:18.478689 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d89dcda5-3095-4cd8-af18-5e0b7782a89e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: 7e2f06ae-da11-465b-b76e-0fa88394dc6b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:18.496990 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d89dcda5-3095-4cd8-af18-5e0b7782a89e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:18.497716 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d89dcda5-3095-4cd8-af18-5e0b7782a89e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:18.498307 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d89dcda5-3095-4cd8-af18-5e0b7782a89e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:18.499177 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d89dcda5-3095-4cd8-af18-5e0b7782a89e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:18.499793 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d89dcda5-3095-4cd8-af18-5e0b7782a89e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:18.500394 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d89dcda5-3095-4cd8-af18-5e0b7782a89e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:18.524747 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-d89dcda5-3095-4cd8-af18-5e0b7782a89e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] HTTP exception thrown: Instance 7e2f06ae-da11-465b-b76e-0fa88394dc6b could not be found. Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d89dcda5-3095-4cd8-af18-5e0b7782a89e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Request method failure captured: Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b HTTP/1.1 Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTVlLVSo3nf8QhYJrJ_2TtoiSXlFSVq0q_Kb2MbPwA8QZUIGfTN2PWvXksVhEDMT3GHVB57HnB1D6meM2daLABluRYsItAPiS-oBEmNBZ93N1V2qPeDfR7XokhEcccKDdTGhSbaj_fB_AOTg2oVK4Lv2gqxVjNnA_YmP6cbr9BDRXOo Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 914dca3de66e476bb9a73c0e7fe97188 Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-VolumesActionsTest-1506380559 Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:54:18.537743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:54:18.540019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/914dca3de66e476bb9a73c0e7fe97188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_914dca3de66e476bb9a73c0e7fe97188"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/914dca3de66e476bb9a73c0e7fe97188"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/914dca3de66e476bb9a73c0e7fe97188"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:54:18.540019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-VolumesActionsTest-1506380559 Aug 29 21:54:18.540019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 914dca3de66e476bb9a73c0e7fe97188 Aug 29 21:54:18.540019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-VolumesActionsTest-1506380559 Aug 29 21:54:18.540019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-VolumesActionsTest-1506380559-project Aug 29 21:54:18.540019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:54:18.540019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:54:18.540019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: aae8fa0892fe4f37b6ba6b3cf70506a8 Aug 29 21:54:18.540019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-VolumesActionsTest-1506380559-project Aug 29 21:54:18.540019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:54:18.540019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 7e2f06ae-da11-465b-b76e-0fa88394dc6b could not be found. Aug 29 21:54:18.540019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '7e2f06ae-da11-465b-b76e-0fa88394dc6b'} Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e2f06ae-da11-465b-b76e-0fa88394dc6b could not be found. Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:54:18.541053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e2f06ae-da11-465b-b76e-0fa88394dc6b could not be found. Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e2f06ae-da11-465b-b76e-0fa88394dc6b could not be found. Aug 29 21:54:18.542544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:54:18.550155 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d89dcda5-3095-4cd8-af18-5e0b7782a89e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Returning 404 to user: Instance 7e2f06ae-da11-465b-b76e-0fa88394dc6b could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:54:18.550155 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d89dcda5-3095-4cd8-af18-5e0b7782a89e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b" status: 404 len: 111 microversion: 2.1 time: 0.080895 Aug 29 21:54:18.553773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 267/525] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:18 2022] GET /compute/v2.1/servers/7e2f06ae-da11-465b-b76e-0fa88394dc6b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:54:18.714005 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-510840100", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "networks": [{"uuid": "0f259729-dd6f-4a5d-8cbe-5b49cb092da0"}]}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:18.778687 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.network.neutron [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] validate_networks() for [('0f259729-dd6f-4a5d-8cbe-5b49cb092da0', None, None, None, None, None)] {{(pid=127883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:54:19.408331 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Flavor limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:54:19.408787 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Image limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:54:19.409268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Flavor pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:54:19.409685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Image pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:54:19.410101 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:54:19.420179 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:19.421471 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:19.422098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:19.423041 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:19.423507 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:19.423940 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:19.460889 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Getting quotas for project 914dca3de66e476bb9a73c0e7fe97188. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:54:19.469039 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Getting quotas for user aae8fa0892fe4f37b6ba6b3cf70506a8 and project 914dca3de66e476bb9a73c0e7fe97188. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:54:19.499368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Going to run 1 instances... {{(pid=127883) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:54:19.501808 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:54:19.660830 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b54d8525-6e3d-4f20-a2ef-9e3cfdb5c2b7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.951248 Aug 29 21:54:19.663639 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 259/526] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:54:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:54:19.690553 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8d419c7a-1259-44ec-8d2e-2679631e27ff tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:19.691582 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-8d419c7a-1259-44ec-8d2e-2679631e27ff tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:19.717575 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-599abf07-36c5-464e-bc12-c31d53927f68 req-e9b04768-c969-4ce7-a8d0-7bbf264ffe60 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "a113fdd6-1fae-452e-89ef-e498da4721d8", "create_info": {"type": "qcow2", "new_file": "volume-a113fdd6-1fae-452e-89ef-e498da4721d8.88970c4e-46d9-4632-b9d1-bc523b3e96cb.vhdx", "snapshot_id": "88970c4e-46d9-4632-b9d1-bc523b3e96cb"}}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:19.745952 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [req-599abf07-36c5-464e-bc12-c31d53927f68 req-e9b04768-c969-4ce7-a8d0-7bbf264ffe60 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f4124b42-2c45-4eaf-83bf-04e147b24cbe(cell1) {{(pid=127882) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 29 21:54:19.746766 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-599abf07-36c5-464e-bc12-c31d53927f68 req-e9b04768-c969-4ce7-a8d0-7bbf264ffe60 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:19.747254 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-599abf07-36c5-464e-bc12-c31d53927f68 req-e9b04768-c969-4ce7-a8d0-7bbf264ffe60 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:19.747731 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-599abf07-36c5-464e-bc12-c31d53927f68 req-e9b04768-c969-4ce7-a8d0-7bbf264ffe60 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:19.815864 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-599abf07-36c5-464e-bc12-c31d53927f68 req-e9b04768-c969-4ce7-a8d0-7bbf264ffe60 admin admin] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:19.817191 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-599abf07-36c5-464e-bc12-c31d53927f68 req-e9b04768-c969-4ce7-a8d0-7bbf264ffe60 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:19.817872 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-599abf07-36c5-464e-bc12-c31d53927f68 req-e9b04768-c969-4ce7-a8d0-7bbf264ffe60 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:19.846841 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-8d419c7a-1259-44ec-8d2e-2679631e27ff tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:19.853102 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-599abf07-36c5-464e-bc12-c31d53927f68 req-e9b04768-c969-4ce7-a8d0-7bbf264ffe60 admin admin] 10.222.0.121 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.344687 Aug 29 21:54:19.854295 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 268/527] 10.222.0.121 () {64 vars in 1327 bytes} [Mon Aug 29 21:54:19 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:54:19.865998 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-8d419c7a-1259-44ec-8d2e-2679631e27ff tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1213 microversion: 2.1 time: 0.183941 Aug 29 21:54:19.865998 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 260/528] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:19 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1213 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:20.883743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2015ae5b-31b4-4340-a8ee-b685e6eee68e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:20.884776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2015ae5b-31b4-4340-a8ee-b685e6eee68e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:20.895546 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2015ae5b-31b4-4340-a8ee-b685e6eee68e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:20.896036 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2015ae5b-31b4-4340-a8ee-b685e6eee68e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:20.896722 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2015ae5b-31b4-4340-a8ee-b685e6eee68e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:20.897455 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2015ae5b-31b4-4340-a8ee-b685e6eee68e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:20.897915 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2015ae5b-31b4-4340-a8ee-b685e6eee68e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:20.899120 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2015ae5b-31b4-4340-a8ee-b685e6eee68e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:20.970775 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2015ae5b-31b4-4340-a8ee-b685e6eee68e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:20.979335 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2015ae5b-31b4-4340-a8ee-b685e6eee68e tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1217 microversion: 2.1 time: 0.100543 Aug 29 21:54:20.982845 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 269/529] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:20 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:22.011795 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6b35ab42-8c8d-4bae-81c2-103fe9c54d83 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:22.013668 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6b35ab42-8c8d-4bae-81c2-103fe9c54d83 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:22.022015 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b35ab42-8c8d-4bae-81c2-103fe9c54d83 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:22.022720 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b35ab42-8c8d-4bae-81c2-103fe9c54d83 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:22.024208 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b35ab42-8c8d-4bae-81c2-103fe9c54d83 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:22.024655 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b35ab42-8c8d-4bae-81c2-103fe9c54d83 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:22.025334 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b35ab42-8c8d-4bae-81c2-103fe9c54d83 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:22.025858 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6b35ab42-8c8d-4bae-81c2-103fe9c54d83 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:22.115492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6b35ab42-8c8d-4bae-81c2-103fe9c54d83 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:22.131548 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6b35ab42-8c8d-4bae-81c2-103fe9c54d83 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1217 microversion: 2.1 time: 0.130907 Aug 29 21:54:22.132990 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 261/530] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:21 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:23.154006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5410f3a9-3425-4756-8a97-6e7c5c867385 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:23.154636 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5410f3a9-3425-4756-8a97-6e7c5c867385 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:23.163089 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5410f3a9-3425-4756-8a97-6e7c5c867385 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:23.163206 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5410f3a9-3425-4756-8a97-6e7c5c867385 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:23.163612 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5410f3a9-3425-4756-8a97-6e7c5c867385 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:23.164744 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5410f3a9-3425-4756-8a97-6e7c5c867385 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:23.165536 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5410f3a9-3425-4756-8a97-6e7c5c867385 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:23.166134 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5410f3a9-3425-4756-8a97-6e7c5c867385 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:23.277059 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5410f3a9-3425-4756-8a97-6e7c5c867385 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:23.294560 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5410f3a9-3425-4756-8a97-6e7c5c867385 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1265 microversion: 2.1 time: 0.141635 Aug 29 21:54:23.295165 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 270/531] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:23 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:24.331768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d54d259f-e9fb-4431-8c4f-b83ee1db6564 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:24.332948 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d54d259f-e9fb-4431-8c4f-b83ee1db6564 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:24.341452 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d54d259f-e9fb-4431-8c4f-b83ee1db6564 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:24.341933 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d54d259f-e9fb-4431-8c4f-b83ee1db6564 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:24.342442 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d54d259f-e9fb-4431-8c4f-b83ee1db6564 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:24.343167 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d54d259f-e9fb-4431-8c4f-b83ee1db6564 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:24.343828 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d54d259f-e9fb-4431-8c4f-b83ee1db6564 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:24.344420 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d54d259f-e9fb-4431-8c4f-b83ee1db6564 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:24.482799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d54d259f-e9fb-4431-8c4f-b83ee1db6564 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:24.503409 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d54d259f-e9fb-4431-8c4f-b83ee1db6564 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1273 microversion: 2.1 time: 0.188344 Aug 29 21:54:24.504020 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 262/532] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:24 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1273 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:25.528439 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-510287d8-d98c-4964-b261-8f2b26346234 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:25.530316 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-510287d8-d98c-4964-b261-8f2b26346234 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:25.541831 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-510287d8-d98c-4964-b261-8f2b26346234 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:25.542334 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-510287d8-d98c-4964-b261-8f2b26346234 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:25.542770 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-510287d8-d98c-4964-b261-8f2b26346234 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:25.543598 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-510287d8-d98c-4964-b261-8f2b26346234 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:25.543941 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-510287d8-d98c-4964-b261-8f2b26346234 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:25.544582 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-510287d8-d98c-4964-b261-8f2b26346234 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:25.722174 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-20f39331-0a0d-4cc4-986e-35a66a96a2db req-178cb659-4fc6-4bd1-aae6-9dbf996abe51 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "a113fdd6-1fae-452e-89ef-e498da4721d8", "create_info": {"type": "qcow2", "new_file": "volume-a113fdd6-1fae-452e-89ef-e498da4721d8.633fe75c-7495-4c78-89f6-524f8fda98ea.vhdx", "snapshot_id": "633fe75c-7495-4c78-89f6-524f8fda98ea"}}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:25.725590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-20f39331-0a0d-4cc4-986e-35a66a96a2db req-178cb659-4fc6-4bd1-aae6-9dbf996abe51 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:25.726153 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-20f39331-0a0d-4cc4-986e-35a66a96a2db req-178cb659-4fc6-4bd1-aae6-9dbf996abe51 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:25.729522 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-20f39331-0a0d-4cc4-986e-35a66a96a2db req-178cb659-4fc6-4bd1-aae6-9dbf996abe51 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:25.741834 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-20f39331-0a0d-4cc4-986e-35a66a96a2db req-178cb659-4fc6-4bd1-aae6-9dbf996abe51 admin admin] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:25.743633 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-20f39331-0a0d-4cc4-986e-35a66a96a2db req-178cb659-4fc6-4bd1-aae6-9dbf996abe51 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:25.746555 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-20f39331-0a0d-4cc4-986e-35a66a96a2db req-178cb659-4fc6-4bd1-aae6-9dbf996abe51 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:25.774641 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-20f39331-0a0d-4cc4-986e-35a66a96a2db req-178cb659-4fc6-4bd1-aae6-9dbf996abe51 admin admin] 10.222.0.121 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.288184 Aug 29 21:54:25.777193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 271/533] 10.222.0.121 () {64 vars in 1327 bytes} [Mon Aug 29 21:54:25 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:54:25.832046 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-510287d8-d98c-4964-b261-8f2b26346234 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:25.848597 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-510287d8-d98c-4964-b261-8f2b26346234 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1313 microversion: 2.1 time: 0.326685 Aug 29 21:54:25.850433 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 263/534] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:25 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:26.675683 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-36925166-fc23-4a98-b48f-c5057d774d3d req-38573981-5433-4fcf-9a45-3ba465e6ee04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3", "tag": "70d10538-dffc-400d-a7dd-5e45fabcbf46"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:26.697856 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-36925166-fc23-4a98-b48f-c5057d774d3d req-38573981-5433-4fcf-9a45-3ba465e6ee04 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:26.700744 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-36925166-fc23-4a98-b48f-c5057d774d3d req-38573981-5433-4fcf-9a45-3ba465e6ee04 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:26.700744 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-36925166-fc23-4a98-b48f-c5057d774d3d req-38573981-5433-4fcf-9a45-3ba465e6ee04 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:26.712648 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-36925166-fc23-4a98-b48f-c5057d774d3d req-38573981-5433-4fcf-9a45-3ba465e6ee04 service nova] Creating event network-changed:70d10538-dffc-400d-a7dd-5e45fabcbf46 for instance bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 on hv-cinder-85426 Aug 29 21:54:26.717613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-36925166-fc23-4a98-b48f-c5057d774d3d req-38573981-5433-4fcf-9a45-3ba465e6ee04 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057102 Aug 29 21:54:26.718213 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 272/535] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:54:26.876510 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e0718228-02ca-4ac4-93f3-08dab44dd5bd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:26.877982 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e0718228-02ca-4ac4-93f3-08dab44dd5bd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:26.886920 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e0718228-02ca-4ac4-93f3-08dab44dd5bd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:26.887989 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e0718228-02ca-4ac4-93f3-08dab44dd5bd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:26.888847 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e0718228-02ca-4ac4-93f3-08dab44dd5bd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:26.889841 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e0718228-02ca-4ac4-93f3-08dab44dd5bd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:26.890891 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e0718228-02ca-4ac4-93f3-08dab44dd5bd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:26.891740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e0718228-02ca-4ac4-93f3-08dab44dd5bd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:27.080099 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e0718228-02ca-4ac4-93f3-08dab44dd5bd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:27.105715 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e0718228-02ca-4ac4-93f3-08dab44dd5bd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1313 microversion: 2.1 time: 0.231695 Aug 29 21:54:27.106260 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 264/536] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:26 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:28.129523 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-11b63ed3-4cfe-45d0-847b-942de3996709 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:28.130369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-11b63ed3-4cfe-45d0-847b-942de3996709 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:28.138143 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11b63ed3-4cfe-45d0-847b-942de3996709 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:28.138437 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11b63ed3-4cfe-45d0-847b-942de3996709 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:28.138937 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11b63ed3-4cfe-45d0-847b-942de3996709 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:28.139891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11b63ed3-4cfe-45d0-847b-942de3996709 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:28.140443 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11b63ed3-4cfe-45d0-847b-942de3996709 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:28.140988 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-11b63ed3-4cfe-45d0-847b-942de3996709 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:28.363557 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-11b63ed3-4cfe-45d0-847b-942de3996709 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:28.373453 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-11b63ed3-4cfe-45d0-847b-942de3996709 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1313 microversion: 2.1 time: 0.248593 Aug 29 21:54:28.380741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 273/537] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:28 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:29.395791 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7a5e6f4d-54d2-476e-8e6c-6afece13dec8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:29.397290 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7a5e6f4d-54d2-476e-8e6c-6afece13dec8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:29.405042 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7a5e6f4d-54d2-476e-8e6c-6afece13dec8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:29.405541 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7a5e6f4d-54d2-476e-8e6c-6afece13dec8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:29.406037 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7a5e6f4d-54d2-476e-8e6c-6afece13dec8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:29.406961 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7a5e6f4d-54d2-476e-8e6c-6afece13dec8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:29.407442 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7a5e6f4d-54d2-476e-8e6c-6afece13dec8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:29.408016 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7a5e6f4d-54d2-476e-8e6c-6afece13dec8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:29.436268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=4 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:29.719149 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7a5e6f4d-54d2-476e-8e6c-6afece13dec8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:29.769502 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7a5e6f4d-54d2-476e-8e6c-6afece13dec8 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1313 microversion: 2.1 time: 0.378094 Aug 29 21:54:29.784122 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 265/538] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:29 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:30.287934 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-5a515d6d-17b5-4b96-8b8f-4c0fba9bdea0 req-2490a9c2-cd86-4a28-9a95-e6dd3b6a0113 admin admin] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:30.292911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-5a515d6d-17b5-4b96-8b8f-4c0fba9bdea0 req-2490a9c2-cd86-4a28-9a95-e6dd3b6a0113 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:30.293712 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-5a515d6d-17b5-4b96-8b8f-4c0fba9bdea0 req-2490a9c2-cd86-4a28-9a95-e6dd3b6a0113 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:30.294152 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-5a515d6d-17b5-4b96-8b8f-4c0fba9bdea0 req-2490a9c2-cd86-4a28-9a95-e6dd3b6a0113 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:30.304128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-5a515d6d-17b5-4b96-8b8f-4c0fba9bdea0 req-2490a9c2-cd86-4a28-9a95-e6dd3b6a0113 admin admin] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:30.304943 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-5a515d6d-17b5-4b96-8b8f-4c0fba9bdea0 req-2490a9c2-cd86-4a28-9a95-e6dd3b6a0113 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:30.305535 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-5a515d6d-17b5-4b96-8b8f-4c0fba9bdea0 req-2490a9c2-cd86-4a28-9a95-e6dd3b6a0113 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:30.331348 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-5a515d6d-17b5-4b96-8b8f-4c0fba9bdea0 req-2490a9c2-cd86-4a28-9a95-e6dd3b6a0113 admin admin] 10.222.0.121 "DELETE /compute/v2.1/os-assisted-volume-snapshots/715303fa-f5cc-42bc-915a-75cdbc3743cc?delete_info=%7B%22file_to_merge%22:%20%22volume-a113fdd6-1fae-452e-89ef-e498da4721d8.715303fa-f5cc-42bc-915a-75cdbc3743cc.vhdx%22,%20%22volume_id%22:%20%22a113fdd6-1fae-452e-89ef-e498da4721d8%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.135816 Aug 29 21:54:30.332538 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 274/539] 10.222.0.121 () {62 vars in 1801 bytes} [Mon Aug 29 21:54:30 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/715303fa-f5cc-42bc-915a-75cdbc3743cc?delete_info=%7B%22file_to_merge%22:%20%22volume-a113fdd6-1fae-452e-89ef-e498da4721d8.715303fa-f5cc-42bc-915a-75cdbc3743cc.vhdx%22,%20%22volume_id%22:%20%22a113fdd6-1fae-452e-89ef-e498da4721d8%22%7D => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:54:30.796320 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2c6bcf9f-1bcf-4f75-bc7a-442d59a4d9e7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:30.797538 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2c6bcf9f-1bcf-4f75-bc7a-442d59a4d9e7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:30.799858 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-92eac6e0-6921-4756-b2f7-cf7a8f909e05 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:30.800614 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-92eac6e0-6921-4756-b2f7-cf7a8f909e05 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:30.808893 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:30.809841 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=8 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:30.810949 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92eac6e0-6921-4756-b2f7-cf7a8f909e05 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:30.811446 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92eac6e0-6921-4756-b2f7-cf7a8f909e05 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:30.811883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92eac6e0-6921-4756-b2f7-cf7a8f909e05 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:30.812048 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2c6bcf9f-1bcf-4f75-bc7a-442d59a4d9e7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:30.812416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2c6bcf9f-1bcf-4f75-bc7a-442d59a4d9e7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:30.812892 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2c6bcf9f-1bcf-4f75-bc7a-442d59a4d9e7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:30.813496 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92eac6e0-6921-4756-b2f7-cf7a8f909e05 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:30.813614 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2c6bcf9f-1bcf-4f75-bc7a-442d59a4d9e7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:30.813969 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92eac6e0-6921-4756-b2f7-cf7a8f909e05 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:30.814082 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2c6bcf9f-1bcf-4f75-bc7a-442d59a4d9e7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:30.814401 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-92eac6e0-6921-4756-b2f7-cf7a8f909e05 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:30.814523 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2c6bcf9f-1bcf-4f75-bc7a-442d59a4d9e7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:30.877973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-92eac6e0-6921-4756-b2f7-cf7a8f909e05 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments/df927b91-3b11-455f-8536-10a7792d03ae" status: 200 len: 194 microversion: 2.20 time: 0.082738 Aug 29 21:54:30.878703 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 275/540] 10.222.0.83 () {60 vars in 1454 bytes} [Mon Aug 29 21:54:30 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments/df927b91-3b11-455f-8536-10a7792d03ae => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:54:31.010443 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d488c2b9-f4c6-4551-8c36-9892480b6a0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:31.011312 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d488c2b9-f4c6-4551-8c36-9892480b6a0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:31.019977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d488c2b9-f4c6-4551-8c36-9892480b6a0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:31.020745 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d488c2b9-f4c6-4551-8c36-9892480b6a0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:31.021408 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d488c2b9-f4c6-4551-8c36-9892480b6a0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:31.022205 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d488c2b9-f4c6-4551-8c36-9892480b6a0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:31.022730 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d488c2b9-f4c6-4551-8c36-9892480b6a0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:31.023231 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d488c2b9-f4c6-4551-8c36-9892480b6a0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:31.062416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2c6bcf9f-1bcf-4f75-bc7a-442d59a4d9e7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:31.073861 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2c6bcf9f-1bcf-4f75-bc7a-442d59a4d9e7 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1313 microversion: 2.1 time: 0.282145 Aug 29 21:54:31.075002 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 266/541] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:30 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:31.156389 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-d488c2b9-f4c6-4551-8c36-9892480b6a0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lazy-loading 'services' on Instance uuid 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:54:31.414171 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d488c2b9-f4c6-4551-8c36-9892480b6a0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments/df927b91-3b11-455f-8536-10a7792d03ae" status: 202 len: 0 microversion: 2.20 time: 0.407872 Aug 29 21:54:31.414881 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 276/542] 10.222.0.83 () {60 vars in 1457 bytes} [Mon Aug 29 21:54:31 2022] DELETE /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments/df927b91-3b11-455f-8536-10a7792d03ae => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:54:31.424757 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-80ff4f18-31fe-42a4-bdaf-c2eb4d488737 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:31.427907 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-80ff4f18-31fe-42a4-bdaf-c2eb4d488737 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:31.436018 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ff4f18-31fe-42a4-bdaf-c2eb4d488737 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:31.436813 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ff4f18-31fe-42a4-bdaf-c2eb4d488737 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:31.437251 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ff4f18-31fe-42a4-bdaf-c2eb4d488737 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:31.438325 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ff4f18-31fe-42a4-bdaf-c2eb4d488737 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:31.438788 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ff4f18-31fe-42a4-bdaf-c2eb4d488737 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:31.439388 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-80ff4f18-31fe-42a4-bdaf-c2eb4d488737 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:31.477150 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-80ff4f18-31fe-42a4-bdaf-c2eb4d488737 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056886 Aug 29 21:54:31.477729 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 267/543] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 21:54:31 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:54:32.100377 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-35374130-6b93-4198-bd97-61a5d17c0a45 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:32.101338 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-35374130-6b93-4198-bd97-61a5d17c0a45 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:32.111943 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-35374130-6b93-4198-bd97-61a5d17c0a45 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:32.112822 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-35374130-6b93-4198-bd97-61a5d17c0a45 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:32.113412 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-35374130-6b93-4198-bd97-61a5d17c0a45 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:32.114274 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-35374130-6b93-4198-bd97-61a5d17c0a45 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:32.114884 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-35374130-6b93-4198-bd97-61a5d17c0a45 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:32.115859 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-35374130-6b93-4198-bd97-61a5d17c0a45 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:32.297775 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-35374130-6b93-4198-bd97-61a5d17c0a45 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:32.317761 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-35374130-6b93-4198-bd97-61a5d17c0a45 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1313 microversion: 2.1 time: 0.223374 Aug 29 21:54:32.319106 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 277/544] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:32 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:32.526689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-96604477-2768-4ba3-be29-9f5d36c093b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:32.534513 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-96604477-2768-4ba3-be29-9f5d36c093b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:32.556031 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-96604477-2768-4ba3-be29-9f5d36c093b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:32.565033 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-96604477-2768-4ba3-be29-9f5d36c093b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:32.566117 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-96604477-2768-4ba3-be29-9f5d36c093b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:32.566904 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-96604477-2768-4ba3-be29-9f5d36c093b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:32.567388 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-96604477-2768-4ba3-be29-9f5d36c093b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:32.567832 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-96604477-2768-4ba3-be29-9f5d36c093b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:32.615907 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-96604477-2768-4ba3-be29-9f5d36c093b2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129136 Aug 29 21:54:32.621419 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 268/545] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 21:54:32 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:54:33.340681 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9c9a810e-0f27-470d-8350-a34ede069cb3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:33.341329 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9c9a810e-0f27-470d-8350-a34ede069cb3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:33.347720 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9c9a810e-0f27-470d-8350-a34ede069cb3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:33.348208 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9c9a810e-0f27-470d-8350-a34ede069cb3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:33.348732 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9c9a810e-0f27-470d-8350-a34ede069cb3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:33.349395 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9c9a810e-0f27-470d-8350-a34ede069cb3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:33.349846 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9c9a810e-0f27-470d-8350-a34ede069cb3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:33.350269 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9c9a810e-0f27-470d-8350-a34ede069cb3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:33.597516 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9c9a810e-0f27-470d-8350-a34ede069cb3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:33.609450 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9c9a810e-0f27-470d-8350-a34ede069cb3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1313 microversion: 2.1 time: 0.273448 Aug 29 21:54:33.610471 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 278/546] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:33 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:33.629998 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-1ddc2a68-f1f0-4f53-9ea2-c0190e6114ae tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:33.637451 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-1ddc2a68-f1f0-4f53-9ea2-c0190e6114ae tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:33.640259 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1ddc2a68-f1f0-4f53-9ea2-c0190e6114ae tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:33.641006 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1ddc2a68-f1f0-4f53-9ea2-c0190e6114ae tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:33.641609 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1ddc2a68-f1f0-4f53-9ea2-c0190e6114ae tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:33.642522 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1ddc2a68-f1f0-4f53-9ea2-c0190e6114ae tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:33.643155 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1ddc2a68-f1f0-4f53-9ea2-c0190e6114ae tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:33.643751 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1ddc2a68-f1f0-4f53-9ea2-c0190e6114ae tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:33.659218 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=100 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:33.677719 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-1ddc2a68-f1f0-4f53-9ea2-c0190e6114ae tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051738 Aug 29 21:54:33.683151 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 269/547] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 21:54:33 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:54:34.650224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-72be13f0-208a-4e87-80fb-6b124bfec4ff tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:34.651515 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-72be13f0-208a-4e87-80fb-6b124bfec4ff tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:34.662292 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-72be13f0-208a-4e87-80fb-6b124bfec4ff tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:34.663135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-72be13f0-208a-4e87-80fb-6b124bfec4ff tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:34.664456 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-72be13f0-208a-4e87-80fb-6b124bfec4ff tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:34.665464 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-72be13f0-208a-4e87-80fb-6b124bfec4ff tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:34.666256 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-72be13f0-208a-4e87-80fb-6b124bfec4ff tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:34.667390 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-72be13f0-208a-4e87-80fb-6b124bfec4ff tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:34.691561 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8cdd490e-ebf7-465e-9c28-8051bd54621c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:34.694220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-8cdd490e-ebf7-465e-9c28-8051bd54621c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:34.720117 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8cdd490e-ebf7-465e-9c28-8051bd54621c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:34.720947 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8cdd490e-ebf7-465e-9c28-8051bd54621c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:34.721549 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8cdd490e-ebf7-465e-9c28-8051bd54621c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:34.722442 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8cdd490e-ebf7-465e-9c28-8051bd54621c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:34.723066 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8cdd490e-ebf7-465e-9c28-8051bd54621c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:34.723663 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8cdd490e-ebf7-465e-9c28-8051bd54621c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:34.764918 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-8cdd490e-ebf7-465e-9c28-8051bd54621c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077487 Aug 29 21:54:34.765871 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 270/548] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 21:54:34 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:54:34.906352 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-72be13f0-208a-4e87-80fb-6b124bfec4ff tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:34.925691 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-72be13f0-208a-4e87-80fb-6b124bfec4ff tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1313 microversion: 2.1 time: 0.283518 Aug 29 21:54:34.938035 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 279/549] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:34 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:35.650909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-65e5d19f-699c-4d1b-a9c0-f2b7315b235c req-d47a207d-46a9-4223-8e2b-6c2949df872a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3", "name": "network-vif-plugged", "status": "completed", "tag": "70d10538-dffc-400d-a7dd-5e45fabcbf46"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:35.662917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-65e5d19f-699c-4d1b-a9c0-f2b7315b235c req-d47a207d-46a9-4223-8e2b-6c2949df872a service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:35.663426 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-65e5d19f-699c-4d1b-a9c0-f2b7315b235c req-d47a207d-46a9-4223-8e2b-6c2949df872a service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:35.663958 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-65e5d19f-699c-4d1b-a9c0-f2b7315b235c req-d47a207d-46a9-4223-8e2b-6c2949df872a service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:35.708309 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-65e5d19f-699c-4d1b-a9c0-f2b7315b235c req-d47a207d-46a9-4223-8e2b-6c2949df872a service nova] Creating event network-vif-plugged:70d10538-dffc-400d-a7dd-5e45fabcbf46 for instance bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 on hv-cinder-85426 Aug 29 21:54:35.724115 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-65e5d19f-699c-4d1b-a9c0-f2b7315b235c req-d47a207d-46a9-4223-8e2b-6c2949df872a service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076113 Aug 29 21:54:35.732427 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 271/550] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:54:35.784205 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9f8ba251-8095-4baf-ba21-c5b7819f36cc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:35.795793 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9f8ba251-8095-4baf-ba21-c5b7819f36cc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:35.800925 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9f8ba251-8095-4baf-ba21-c5b7819f36cc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:35.802038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9f8ba251-8095-4baf-ba21-c5b7819f36cc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:35.802709 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9f8ba251-8095-4baf-ba21-c5b7819f36cc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:35.803782 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9f8ba251-8095-4baf-ba21-c5b7819f36cc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:35.805108 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9f8ba251-8095-4baf-ba21-c5b7819f36cc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:35.805766 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9f8ba251-8095-4baf-ba21-c5b7819f36cc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:35.887029 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9f8ba251-8095-4baf-ba21-c5b7819f36cc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.113180 Aug 29 21:54:35.891966 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 280/551] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 21:54:35 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:54:35.959661 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f19d6ed1-0357-4fe7-a08b-d7a7629f966c tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:35.960471 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f19d6ed1-0357-4fe7-a08b-d7a7629f966c tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:35.972029 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f19d6ed1-0357-4fe7-a08b-d7a7629f966c tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:35.974160 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f19d6ed1-0357-4fe7-a08b-d7a7629f966c tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:35.979284 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f19d6ed1-0357-4fe7-a08b-d7a7629f966c tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:35.979284 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f19d6ed1-0357-4fe7-a08b-d7a7629f966c tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:35.979284 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f19d6ed1-0357-4fe7-a08b-d7a7629f966c tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:35.979284 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f19d6ed1-0357-4fe7-a08b-d7a7629f966c tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:36.158818 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f19d6ed1-0357-4fe7-a08b-d7a7629f966c tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:36.167052 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f19d6ed1-0357-4fe7-a08b-d7a7629f966c tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1313 microversion: 2.1 time: 0.217234 Aug 29 21:54:36.167851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 272/552] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:35 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:36.901113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a3a37d88-80e1-4894-92ab-307baee2f18b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:36.903462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a3a37d88-80e1-4894-92ab-307baee2f18b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:36.910416 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a3a37d88-80e1-4894-92ab-307baee2f18b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:36.910923 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a3a37d88-80e1-4894-92ab-307baee2f18b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:36.911367 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a3a37d88-80e1-4894-92ab-307baee2f18b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:36.912148 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a3a37d88-80e1-4894-92ab-307baee2f18b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:36.912663 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a3a37d88-80e1-4894-92ab-307baee2f18b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:36.913103 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a3a37d88-80e1-4894-92ab-307baee2f18b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:36.947335 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a3a37d88-80e1-4894-92ab-307baee2f18b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051113 Aug 29 21:54:36.954195 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 281/553] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 21:54:36 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:37.025774 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a05382d5-f37e-49ed-bfca-0ff270f51267 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:37.034227 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a05382d5-f37e-49ed-bfca-0ff270f51267 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:37.034227 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a05382d5-f37e-49ed-bfca-0ff270f51267 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:37.034227 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a05382d5-f37e-49ed-bfca-0ff270f51267 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:37.034227 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a05382d5-f37e-49ed-bfca-0ff270f51267 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:37.034626 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a05382d5-f37e-49ed-bfca-0ff270f51267 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:37.034918 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a05382d5-f37e-49ed-bfca-0ff270f51267 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:37.035347 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a05382d5-f37e-49ed-bfca-0ff270f51267 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:37.064298 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a05382d5-f37e-49ed-bfca-0ff270f51267 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Going to try to terminate instance {{(pid=127883) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:54:37.189957 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4890d5fd-7071-4dee-ae03-07a5c37da5f4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:37.190578 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4890d5fd-7071-4dee-ae03-07a5c37da5f4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:37.197825 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4890d5fd-7071-4dee-ae03-07a5c37da5f4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:37.198323 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4890d5fd-7071-4dee-ae03-07a5c37da5f4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:37.198762 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4890d5fd-7071-4dee-ae03-07a5c37da5f4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:37.200112 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4890d5fd-7071-4dee-ae03-07a5c37da5f4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:37.200112 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4890d5fd-7071-4dee-ae03-07a5c37da5f4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:37.200455 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4890d5fd-7071-4dee-ae03-07a5c37da5f4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:37.430065 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4890d5fd-7071-4dee-ae03-07a5c37da5f4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:37.438433 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4890d5fd-7071-4dee-ae03-07a5c37da5f4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1313 microversion: 2.1 time: 0.252116 Aug 29 21:54:37.439258 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 282/554] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:37 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:54:37.511840 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a05382d5-f37e-49ed-bfca-0ff270f51267 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 204 len: 0 microversion: 2.20 time: 0.490464 Aug 29 21:54:37.513021 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 273/555] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 21:54:37 2022] DELETE /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 21:54:37.522198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b5cd0407-df1c-4ef4-a67e-62f902c51137 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:37.523159 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b5cd0407-df1c-4ef4-a67e-62f902c51137 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:37.531447 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5cd0407-df1c-4ef4-a67e-62f902c51137 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:37.532165 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5cd0407-df1c-4ef4-a67e-62f902c51137 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:37.532654 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5cd0407-df1c-4ef4-a67e-62f902c51137 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:37.533551 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5cd0407-df1c-4ef4-a67e-62f902c51137 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:37.533998 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5cd0407-df1c-4ef4-a67e-62f902c51137 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:37.534631 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5cd0407-df1c-4ef4-a67e-62f902c51137 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:37.725405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b5cd0407-df1c-4ef4-a67e-62f902c51137 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:37.735683 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b5cd0407-df1c-4ef4-a67e-62f902c51137 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:37.738105 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b5cd0407-df1c-4ef4-a67e-62f902c51137 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:37.739764 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b5cd0407-df1c-4ef4-a67e-62f902c51137 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.222197 Aug 29 21:54:37.740584 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 283/556] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:54:37 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:54:38.460339 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0bcbd65a-f0b7-4118-a808-43208df65243 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:38.461761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0bcbd65a-f0b7-4118-a808-43208df65243 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:38.471954 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0bcbd65a-f0b7-4118-a808-43208df65243 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:38.472290 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0bcbd65a-f0b7-4118-a808-43208df65243 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:38.475627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0bcbd65a-f0b7-4118-a808-43208df65243 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:38.476974 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0bcbd65a-f0b7-4118-a808-43208df65243 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:38.477455 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0bcbd65a-f0b7-4118-a808-43208df65243 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:38.477892 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0bcbd65a-f0b7-4118-a808-43208df65243 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:38.655608 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0bcbd65a-f0b7-4118-a808-43208df65243 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:38.664860 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0bcbd65a-f0b7-4118-a808-43208df65243 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1313 microversion: 2.1 time: 0.208361 Aug 29 21:54:38.668172 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 274/557] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:38 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:38.771181 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ce1de91f-9e13-4fba-99ea-831cd8e86a3a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:38.771964 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ce1de91f-9e13-4fba-99ea-831cd8e86a3a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:38.778448 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce1de91f-9e13-4fba-99ea-831cd8e86a3a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:38.779225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce1de91f-9e13-4fba-99ea-831cd8e86a3a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:38.779764 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce1de91f-9e13-4fba-99ea-831cd8e86a3a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:38.781936 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce1de91f-9e13-4fba-99ea-831cd8e86a3a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:38.783159 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce1de91f-9e13-4fba-99ea-831cd8e86a3a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:38.783922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ce1de91f-9e13-4fba-99ea-831cd8e86a3a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:38.810494 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:39.013560 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-0f3143e9-0557-4f21-80b7-5c97b0736049 req-ecc66486-87db-4050-b500-fc1cd1a4bccd admin admin] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:39.034951 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-0f3143e9-0557-4f21-80b7-5c97b0736049 req-ecc66486-87db-4050-b500-fc1cd1a4bccd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:39.035987 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-0f3143e9-0557-4f21-80b7-5c97b0736049 req-ecc66486-87db-4050-b500-fc1cd1a4bccd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:39.036092 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-0f3143e9-0557-4f21-80b7-5c97b0736049 req-ecc66486-87db-4050-b500-fc1cd1a4bccd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:39.053500 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ce1de91f-9e13-4fba-99ea-831cd8e86a3a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:39.057182 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-0f3143e9-0557-4f21-80b7-5c97b0736049 req-ecc66486-87db-4050-b500-fc1cd1a4bccd admin admin] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:39.060573 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-0f3143e9-0557-4f21-80b7-5c97b0736049 req-ecc66486-87db-4050-b500-fc1cd1a4bccd admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:39.063763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ce1de91f-9e13-4fba-99ea-831cd8e86a3a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:39.064713 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-0f3143e9-0557-4f21-80b7-5c97b0736049 req-ecc66486-87db-4050-b500-fc1cd1a4bccd admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:39.065216 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ce1de91f-9e13-4fba-99ea-831cd8e86a3a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:39.068626 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ce1de91f-9e13-4fba-99ea-831cd8e86a3a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.305454 Aug 29 21:54:39.069876 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 284/558] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:54:38 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:54:39.083842 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-0f3143e9-0557-4f21-80b7-5c97b0736049 req-ecc66486-87db-4050-b500-fc1cd1a4bccd admin admin] 10.222.0.121 "DELETE /compute/v2.1/os-assisted-volume-snapshots/633fe75c-7495-4c78-89f6-524f8fda98ea?delete_info=%7B%22file_to_merge%22:%20%22volume-a113fdd6-1fae-452e-89ef-e498da4721d8.633fe75c-7495-4c78-89f6-524f8fda98ea.vhdx%22,%20%22volume_id%22:%20%22a113fdd6-1fae-452e-89ef-e498da4721d8%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.151975 Aug 29 21:54:39.084813 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 275/559] 10.222.0.121 () {62 vars in 1801 bytes} [Mon Aug 29 21:54:38 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/633fe75c-7495-4c78-89f6-524f8fda98ea?delete_info=%7B%22file_to_merge%22:%20%22volume-a113fdd6-1fae-452e-89ef-e498da4721d8.633fe75c-7495-4c78-89f6-524f8fda98ea.vhdx%22,%20%22volume_id%22:%20%22a113fdd6-1fae-452e-89ef-e498da4721d8%22%7D => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:54:39.690961 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-de8d083d-9909-4e2a-9946-7b91766da312 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:39.692244 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-de8d083d-9909-4e2a-9946-7b91766da312 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:39.701831 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-de8d083d-9909-4e2a-9946-7b91766da312 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:39.702320 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-de8d083d-9909-4e2a-9946-7b91766da312 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:39.702760 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-de8d083d-9909-4e2a-9946-7b91766da312 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:39.703464 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-de8d083d-9909-4e2a-9946-7b91766da312 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:39.703913 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-de8d083d-9909-4e2a-9946-7b91766da312 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:39.704351 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-de8d083d-9909-4e2a-9946-7b91766da312 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:39.896333 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-de8d083d-9909-4e2a-9946-7b91766da312 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:39.908263 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-de8d083d-9909-4e2a-9946-7b91766da312 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1313 microversion: 2.1 time: 0.217911 Aug 29 21:54:39.908263 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 285/560] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:39 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:40.096448 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6eea1d4d-4928-4aca-a643-809fccb76ce9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:40.139471 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6eea1d4d-4928-4aca-a643-809fccb76ce9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:40.139471 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6eea1d4d-4928-4aca-a643-809fccb76ce9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:40.139471 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6eea1d4d-4928-4aca-a643-809fccb76ce9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:40.139471 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6eea1d4d-4928-4aca-a643-809fccb76ce9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:40.139878 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6eea1d4d-4928-4aca-a643-809fccb76ce9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:40.139878 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6eea1d4d-4928-4aca-a643-809fccb76ce9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:40.139878 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6eea1d4d-4928-4aca-a643-809fccb76ce9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:40.258372 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6eea1d4d-4928-4aca-a643-809fccb76ce9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:40.271690 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6eea1d4d-4928-4aca-a643-809fccb76ce9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:40.273684 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6eea1d4d-4928-4aca-a643-809fccb76ce9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:40.274978 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6eea1d4d-4928-4aca-a643-809fccb76ce9 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.183969 Aug 29 21:54:40.275760 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 276/561] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:54:40 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:54:40.926978 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-01708a45-d9e6-4d49-b692-135ee75d35b1 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:40.928258 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-01708a45-d9e6-4d49-b692-135ee75d35b1 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:40.930331 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=6 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:40.935912 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01708a45-d9e6-4d49-b692-135ee75d35b1 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:40.936406 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01708a45-d9e6-4d49-b692-135ee75d35b1 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:40.936880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01708a45-d9e6-4d49-b692-135ee75d35b1 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:40.937591 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01708a45-d9e6-4d49-b692-135ee75d35b1 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:40.938048 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01708a45-d9e6-4d49-b692-135ee75d35b1 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:40.938477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01708a45-d9e6-4d49-b692-135ee75d35b1 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:41.080282 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-01708a45-d9e6-4d49-b692-135ee75d35b1 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:41.089188 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-01708a45-d9e6-4d49-b692-135ee75d35b1 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1497 microversion: 2.1 time: 0.166093 Aug 29 21:54:41.089789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 286/562] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:40 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:41.145884 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4fc196c8-df17-4bd0-8120-560a6759c5ae tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Action: 'create', calling method: .version_select at 0x7f504062cdc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1342581860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHJm/HbAhywwKuy4U79j8XbgpwZLgfgBehvyxV9SxJb3MnhXhfZfWHuJQk8zgKdoufAnYWq1xotiYbqjYMrBtmob1f0n4IOAJTzJucqGEUkFPokkWOWG4kT4+6CaWWkYA=="}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:41.167966 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-4fc196c8-df17-4bd0-8120-560a6759c5ae tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Getting quotas for project cae92c45ec304a2da9a7cafe49bb8b20. Resources: {'key_pairs'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:54:41.172166 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-4fc196c8-df17-4bd0-8120-560a6759c5ae tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Getting quotas for user 7dcd703ad58a4807b99266f82e8988ca and project cae92c45ec304a2da9a7cafe49bb8b20. Resources: {'key_pairs'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:54:41.290266 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4fc196c8-df17-4bd0-8120-560a6759c5ae tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.149135 Aug 29 21:54:41.290938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 277/563] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 21:54:41 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:54:41.300005 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-fb2adced-2cad-43ab-be19-27fdfb9a8a3e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:41.300972 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-fb2adced-2cad-43ab-be19-27fdfb9a8a3e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:41.308154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fb2adced-2cad-43ab-be19-27fdfb9a8a3e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:41.309069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fb2adced-2cad-43ab-be19-27fdfb9a8a3e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:41.309177 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fb2adced-2cad-43ab-be19-27fdfb9a8a3e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:41.309801 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fb2adced-2cad-43ab-be19-27fdfb9a8a3e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:41.310298 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fb2adced-2cad-43ab-be19-27fdfb9a8a3e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:41.310727 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fb2adced-2cad-43ab-be19-27fdfb9a8a3e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:41.358903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1393530396", "imageRef": "cd605705-d255-4ef8-b331-2253687e8027", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1342581860", "networks": [{"uuid": "9b5990a2-621f-44c5-8028-27c920b42e34"}]}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:41.417836 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.network.neutron [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] validate_networks() for [('9b5990a2-621f-44c5-8028-27c920b42e34', None, None, None, None, None)] {{(pid=127883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:54:41.469600 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-fb2adced-2cad-43ab-be19-27fdfb9a8a3e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:41.478256 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-fb2adced-2cad-43ab-be19-27fdfb9a8a3e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:41.482608 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-fb2adced-2cad-43ab-be19-27fdfb9a8a3e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:41.482608 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-fb2adced-2cad-43ab-be19-27fdfb9a8a3e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.185941 Aug 29 21:54:41.482608 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 287/564] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:54:41 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:54:41.843573 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Flavor limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:54:41.844338 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Image limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:54:41.845363 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Flavor pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:54:41.845926 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Image pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:54:41.846508 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:54:41.858258 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:41.859061 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:41.859861 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:41.860784 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:41.861247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:41.861676 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:41.883747 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Getting quotas for project cae92c45ec304a2da9a7cafe49bb8b20. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:54:41.889635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Getting quotas for user 7dcd703ad58a4807b99266f82e8988ca and project cae92c45ec304a2da9a7cafe49bb8b20. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:54:41.902247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Going to run 1 instances... {{(pid=127883) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:54:41.905062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd605705-d255-4ef8-b331-2253687e8027',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:54:42.096826 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ff20ef36-23a9-4ace-8f94-8f63359f9467 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741683 Aug 29 21:54:42.104071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 278/565] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:54:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:54:42.110825 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-3449af7d-150c-416b-bbbf-1e3991f591aa tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:42.111393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3449af7d-150c-416b-bbbf-1e3991f591aa tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:42.166699 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-3449af7d-150c-416b-bbbf-1e3991f591aa tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:42.174900 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-3449af7d-150c-416b-bbbf-1e3991f591aa tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1259 microversion: 2.1 time: 0.068728 Aug 29 21:54:42.175477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 288/566] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:42 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:42.333736 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-1652c450-c82f-4d2f-80ef-1091b9775c99 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:42.334272 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-1652c450-c82f-4d2f-80ef-1091b9775c99 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:42.341146 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1652c450-c82f-4d2f-80ef-1091b9775c99 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:42.341495 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1652c450-c82f-4d2f-80ef-1091b9775c99 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:42.341930 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1652c450-c82f-4d2f-80ef-1091b9775c99 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:42.342617 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1652c450-c82f-4d2f-80ef-1091b9775c99 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:42.343273 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1652c450-c82f-4d2f-80ef-1091b9775c99 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:42.343626 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1652c450-c82f-4d2f-80ef-1091b9775c99 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:42.370838 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-1652c450-c82f-4d2f-80ef-1091b9775c99 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Going to try to terminate instance {{(pid=127883) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:54:42.508515 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d0c075f4-2000-4052-90d4-533ab35b6e49 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:42.509767 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d0c075f4-2000-4052-90d4-533ab35b6e49 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:42.522461 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d0c075f4-2000-4052-90d4-533ab35b6e49 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:42.523855 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d0c075f4-2000-4052-90d4-533ab35b6e49 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:42.524665 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d0c075f4-2000-4052-90d4-533ab35b6e49 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:42.525979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d0c075f4-2000-4052-90d4-533ab35b6e49 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:42.526807 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d0c075f4-2000-4052-90d4-533ab35b6e49 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:42.527569 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d0c075f4-2000-4052-90d4-533ab35b6e49 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:42.688079 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-1652c450-c82f-4d2f-80ef-1091b9775c99 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "DELETE /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 204 len: 0 microversion: 2.1 time: 0.358036 Aug 29 21:54:42.689075 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 279/567] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:54:42 2022] DELETE /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:54:42.691157 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d0c075f4-2000-4052-90d4-533ab35b6e49 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:42.698574 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-37c306ea-330e-4e6d-8929-d289073a0d25 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:42.699281 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-37c306ea-330e-4e6d-8929-d289073a0d25 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:42.701411 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:42.702483 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d0c075f4-2000-4052-90d4-533ab35b6e49 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:42.704060 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d0c075f4-2000-4052-90d4-533ab35b6e49 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:42.705453 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d0c075f4-2000-4052-90d4-533ab35b6e49 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1724 microversion: 2.20 time: 0.204665 Aug 29 21:54:42.706016 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 289/568] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:54:42 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:54:42.706245 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-37c306ea-330e-4e6d-8929-d289073a0d25 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:42.706884 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-37c306ea-330e-4e6d-8929-d289073a0d25 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:42.707340 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-37c306ea-330e-4e6d-8929-d289073a0d25 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:42.708040 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-37c306ea-330e-4e6d-8929-d289073a0d25 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:42.708658 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-37c306ea-330e-4e6d-8929-d289073a0d25 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:42.709093 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-37c306ea-330e-4e6d-8929-d289073a0d25 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:42.867261 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-37c306ea-330e-4e6d-8929-d289073a0d25 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:42.878969 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-37c306ea-330e-4e6d-8929-d289073a0d25 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1503 microversion: 2.1 time: 0.185197 Aug 29 21:54:42.894269 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 280/569] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:42 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:54:43.200745 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-39244faf-559f-4d03-b503-6b12be9c6da7 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:43.201966 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-39244faf-559f-4d03-b503-6b12be9c6da7 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:43.303523 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-39244faf-559f-4d03-b503-6b12be9c6da7 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:43.311330 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-39244faf-559f-4d03-b503-6b12be9c6da7 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1259 microversion: 2.1 time: 0.118735 Aug 29 21:54:43.312006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 290/570] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:43 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1259 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:43.730267 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-bad80f18-f8c2-4615-851f-c2c3fa8499e8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:43.730823 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-bad80f18-f8c2-4615-851f-c2c3fa8499e8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:43.738313 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bad80f18-f8c2-4615-851f-c2c3fa8499e8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:43.739187 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bad80f18-f8c2-4615-851f-c2c3fa8499e8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:43.739627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bad80f18-f8c2-4615-851f-c2c3fa8499e8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:43.740561 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bad80f18-f8c2-4615-851f-c2c3fa8499e8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:43.741792 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bad80f18-f8c2-4615-851f-c2c3fa8499e8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:43.741792 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bad80f18-f8c2-4615-851f-c2c3fa8499e8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:43.814990 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-bad80f18-f8c2-4615-851f-c2c3fa8499e8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:43.824625 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-bad80f18-f8c2-4615-851f-c2c3fa8499e8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:43.826070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-bad80f18-f8c2-4615-851f-c2c3fa8499e8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:43.827328 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-bad80f18-f8c2-4615-851f-c2c3fa8499e8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1657 microversion: 2.20 time: 0.102113 Aug 29 21:54:43.827899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 281/571] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:54:43 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1657 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:54:43.900777 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-42d644eb-a9e0-46f4-9cde-e463cb12ede4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:43.901389 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-42d644eb-a9e0-46f4-9cde-e463cb12ede4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:43.907507 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-42d644eb-a9e0-46f4-9cde-e463cb12ede4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:43.908000 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-42d644eb-a9e0-46f4-9cde-e463cb12ede4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:43.908427 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-42d644eb-a9e0-46f4-9cde-e463cb12ede4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:43.909363 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-42d644eb-a9e0-46f4-9cde-e463cb12ede4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:43.909814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-42d644eb-a9e0-46f4-9cde-e463cb12ede4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:43.910231 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-42d644eb-a9e0-46f4-9cde-e463cb12ede4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:44.035414 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-f7af33c8-ae16-4112-b127-157641594711 req-ced86723-d8c5-404e-ae06-858d8a7d803c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e60ebcd-98c1-4442-9c72-f4d9760c8d6f", "name": "network-vif-deleted", "tag": "b49d987f-0fff-47f7-acee-6d31bbdeab4b"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:44.047699 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-f7af33c8-ae16-4112-b127-157641594711 req-ced86723-d8c5-404e-ae06-858d8a7d803c service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:44.047699 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-f7af33c8-ae16-4112-b127-157641594711 req-ced86723-d8c5-404e-ae06-858d8a7d803c service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:44.047976 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-f7af33c8-ae16-4112-b127-157641594711 req-ced86723-d8c5-404e-ae06-858d8a7d803c service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:44.061481 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-f7af33c8-ae16-4112-b127-157641594711 req-ced86723-d8c5-404e-ae06-858d8a7d803c service nova] Creating event network-vif-deleted:b49d987f-0fff-47f7-acee-6d31bbdeab4b for instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f on hv-cinder-85426 Aug 29 21:54:44.067291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-f7af33c8-ae16-4112-b127-157641594711 req-ced86723-d8c5-404e-ae06-858d8a7d803c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038152 Aug 29 21:54:44.068842 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 282/572] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:54:44.109603 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-42d644eb-a9e0-46f4-9cde-e463cb12ede4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:44.120734 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-42d644eb-a9e0-46f4-9cde-e463cb12ede4 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1503 microversion: 2.1 time: 0.221842 Aug 29 21:54:44.120734 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 291/573] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:43 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:44.334047 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f73b61c1-d4aa-44a0-8962-62ddb7799310 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:44.335253 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f73b61c1-d4aa-44a0-8962-62ddb7799310 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:44.342454 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f73b61c1-d4aa-44a0-8962-62ddb7799310 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:44.343051 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f73b61c1-d4aa-44a0-8962-62ddb7799310 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:44.343565 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f73b61c1-d4aa-44a0-8962-62ddb7799310 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:44.344335 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f73b61c1-d4aa-44a0-8962-62ddb7799310 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:44.344887 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f73b61c1-d4aa-44a0-8962-62ddb7799310 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:44.345381 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f73b61c1-d4aa-44a0-8962-62ddb7799310 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:44.407649 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f73b61c1-d4aa-44a0-8962-62ddb7799310 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:44.415863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f73b61c1-d4aa-44a0-8962-62ddb7799310 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1263 microversion: 2.1 time: 0.086226 Aug 29 21:54:44.416569 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 283/574] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:44 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1263 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:44.851661 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f6699d7d-4a40-4ae2-96b9-b29556e98fd2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:44.852488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f6699d7d-4a40-4ae2-96b9-b29556e98fd2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:44.862974 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6699d7d-4a40-4ae2-96b9-b29556e98fd2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:44.863802 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6699d7d-4a40-4ae2-96b9-b29556e98fd2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:44.864322 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6699d7d-4a40-4ae2-96b9-b29556e98fd2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:44.865140 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6699d7d-4a40-4ae2-96b9-b29556e98fd2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:44.865759 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6699d7d-4a40-4ae2-96b9-b29556e98fd2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:44.866431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6699d7d-4a40-4ae2-96b9-b29556e98fd2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:44.946561 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f6699d7d-4a40-4ae2-96b9-b29556e98fd2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:44.957685 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f6699d7d-4a40-4ae2-96b9-b29556e98fd2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:44.959099 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f6699d7d-4a40-4ae2-96b9-b29556e98fd2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:44.962039 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f6699d7d-4a40-4ae2-96b9-b29556e98fd2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1657 microversion: 2.20 time: 0.114468 Aug 29 21:54:44.981367 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 292/575] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:54:44 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1657 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:54:45.141521 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e1d8dec0-3200-408d-a5ca-976c98d70293 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:45.142176 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e1d8dec0-3200-408d-a5ca-976c98d70293 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:45.149883 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e1d8dec0-3200-408d-a5ca-976c98d70293 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:45.150429 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e1d8dec0-3200-408d-a5ca-976c98d70293 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:45.150945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e1d8dec0-3200-408d-a5ca-976c98d70293 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:45.151696 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e1d8dec0-3200-408d-a5ca-976c98d70293 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:45.152157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e1d8dec0-3200-408d-a5ca-976c98d70293 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:45.152610 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e1d8dec0-3200-408d-a5ca-976c98d70293 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:45.362152 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e1d8dec0-3200-408d-a5ca-976c98d70293 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:45.371244 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e1d8dec0-3200-408d-a5ca-976c98d70293 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1503 microversion: 2.1 time: 0.235168 Aug 29 21:54:45.371874 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 284/576] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:45 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:45.440235 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-be13c1e9-ed3f-40f3-8e68-b987897c250f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:45.440879 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-be13c1e9-ed3f-40f3-8e68-b987897c250f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:45.447879 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-be13c1e9-ed3f-40f3-8e68-b987897c250f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:45.448393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-be13c1e9-ed3f-40f3-8e68-b987897c250f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:45.448858 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-be13c1e9-ed3f-40f3-8e68-b987897c250f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:45.449619 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-be13c1e9-ed3f-40f3-8e68-b987897c250f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:45.450083 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-be13c1e9-ed3f-40f3-8e68-b987897c250f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:45.450513 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-be13c1e9-ed3f-40f3-8e68-b987897c250f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:45.519717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-be13c1e9-ed3f-40f3-8e68-b987897c250f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:45.528447 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-be13c1e9-ed3f-40f3-8e68-b987897c250f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1263 microversion: 2.1 time: 0.092089 Aug 29 21:54:45.529048 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 293/577] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:45 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1263 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:45.985491 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7b6a0c94-2ca8-438f-a525-ca3fed0e964c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:45.986221 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7b6a0c94-2ca8-438f-a525-ca3fed0e964c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:45.992910 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7b6a0c94-2ca8-438f-a525-ca3fed0e964c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:45.993444 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7b6a0c94-2ca8-438f-a525-ca3fed0e964c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:45.993886 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7b6a0c94-2ca8-438f-a525-ca3fed0e964c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:45.994692 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7b6a0c94-2ca8-438f-a525-ca3fed0e964c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:45.995154 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7b6a0c94-2ca8-438f-a525-ca3fed0e964c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:45.995625 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7b6a0c94-2ca8-438f-a525-ca3fed0e964c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:46.066962 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7b6a0c94-2ca8-438f-a525-ca3fed0e964c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:46.083652 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7b6a0c94-2ca8-438f-a525-ca3fed0e964c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:46.087277 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7b6a0c94-2ca8-438f-a525-ca3fed0e964c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:46.089400 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7b6a0c94-2ca8-438f-a525-ca3fed0e964c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1657 microversion: 2.20 time: 0.107685 Aug 29 21:54:46.090409 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 285/578] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:54:45 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1657 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:54:46.393881 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-dfdc34cd-2798-44d3-a19d-94ff6c1da101 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:46.394684 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-dfdc34cd-2798-44d3-a19d-94ff6c1da101 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:46.401846 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dfdc34cd-2798-44d3-a19d-94ff6c1da101 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:46.402343 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dfdc34cd-2798-44d3-a19d-94ff6c1da101 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:46.402781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dfdc34cd-2798-44d3-a19d-94ff6c1da101 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:46.403496 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dfdc34cd-2798-44d3-a19d-94ff6c1da101 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:46.403960 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dfdc34cd-2798-44d3-a19d-94ff6c1da101 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:46.404519 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dfdc34cd-2798-44d3-a19d-94ff6c1da101 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:46.553081 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d47e8070-14d2-4eee-b2f9-b13996cd4022 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:46.556293 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d47e8070-14d2-4eee-b2f9-b13996cd4022 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:46.568342 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d47e8070-14d2-4eee-b2f9-b13996cd4022 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:46.569321 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d47e8070-14d2-4eee-b2f9-b13996cd4022 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:46.570598 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d47e8070-14d2-4eee-b2f9-b13996cd4022 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:46.573625 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d47e8070-14d2-4eee-b2f9-b13996cd4022 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:46.573625 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d47e8070-14d2-4eee-b2f9-b13996cd4022 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:46.574463 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d47e8070-14d2-4eee-b2f9-b13996cd4022 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:46.604348 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:46.676665 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d47e8070-14d2-4eee-b2f9-b13996cd4022 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:46.687579 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-dfdc34cd-2798-44d3-a19d-94ff6c1da101 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:46.688128 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d47e8070-14d2-4eee-b2f9-b13996cd4022 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1255 microversion: 2.1 time: 0.140471 Aug 29 21:54:46.688987 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 286/579] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:46 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1255 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:54:46.700733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-dfdc34cd-2798-44d3-a19d-94ff6c1da101 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1503 microversion: 2.1 time: 0.310723 Aug 29 21:54:46.702455 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 294/580] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:46 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1503 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:47.126630 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:47.128055 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:47.159614 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:47.160132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:47.160693 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:47.161495 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:47.162271 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:47.162999 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:47.213083 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:47.213664 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:47.214181 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:47.214746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lazy-loading 'fault' on Instance uuid 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:54:47.215558 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-53653eb5-c155-4752-8223-763663b8369f req-7e5b7f24-2e05-4785-8a0c-b58c0f63975c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3", "name": "network-vif-deleted", "tag": "70d10538-dffc-400d-a7dd-5e45fabcbf46"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:47.234356 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-53653eb5-c155-4752-8223-763663b8369f req-7e5b7f24-2e05-4785-8a0c-b58c0f63975c service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:47.234847 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-53653eb5-c155-4752-8223-763663b8369f req-7e5b7f24-2e05-4785-8a0c-b58c0f63975c service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:47.235255 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-53653eb5-c155-4752-8223-763663b8369f req-7e5b7f24-2e05-4785-8a0c-b58c0f63975c service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:47.248411 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-53653eb5-c155-4752-8223-763663b8369f req-7e5b7f24-2e05-4785-8a0c-b58c0f63975c service nova] Creating event network-vif-deleted:70d10538-dffc-400d-a7dd-5e45fabcbf46 for instance bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 on hv-cinder-85426 Aug 29 21:54:47.253719 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-53653eb5-c155-4752-8223-763663b8369f req-7e5b7f24-2e05-4785-8a0c-b58c0f63975c service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045478 Aug 29 21:54:47.254566 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 295/581] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:54:47.264858 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:47.276408 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:47.278119 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:47.279327 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-face763e-a281-4210-bcb9-ae3da78b4998 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1371 microversion: 2.20 time: 0.159543 Aug 29 21:54:47.279898 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 287/582] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:54:47 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:54:47.429635 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-666f4722-184b-47b9-81e3-16fc4e53933a req-7e22c642-e63b-4785-a727-c0abe586b93b admin admin] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:47.433296 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-666f4722-184b-47b9-81e3-16fc4e53933a req-7e22c642-e63b-4785-a727-c0abe586b93b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:47.433796 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-666f4722-184b-47b9-81e3-16fc4e53933a req-7e22c642-e63b-4785-a727-c0abe586b93b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:47.442145 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-666f4722-184b-47b9-81e3-16fc4e53933a req-7e22c642-e63b-4785-a727-c0abe586b93b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:47.443702 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-666f4722-184b-47b9-81e3-16fc4e53933a req-7e22c642-e63b-4785-a727-c0abe586b93b admin admin] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:47.444216 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-666f4722-184b-47b9-81e3-16fc4e53933a req-7e22c642-e63b-4785-a727-c0abe586b93b admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:47.444701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-666f4722-184b-47b9-81e3-16fc4e53933a req-7e22c642-e63b-4785-a727-c0abe586b93b admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:47.468618 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-666f4722-184b-47b9-81e3-16fc4e53933a req-7e22c642-e63b-4785-a727-c0abe586b93b admin admin] 10.222.0.121 "DELETE /compute/v2.1/os-assisted-volume-snapshots/88970c4e-46d9-4632-b9d1-bc523b3e96cb?delete_info=%7B%22file_to_merge%22:%20%22volume-a113fdd6-1fae-452e-89ef-e498da4721d8.88970c4e-46d9-4632-b9d1-bc523b3e96cb.vhdx%22,%20%22volume_id%22:%20%22a113fdd6-1fae-452e-89ef-e498da4721d8%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.107899 Aug 29 21:54:47.469606 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 296/583] 10.222.0.121 () {62 vars in 1801 bytes} [Mon Aug 29 21:54:47 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/88970c4e-46d9-4632-b9d1-bc523b3e96cb?delete_info=%7B%22file_to_merge%22:%20%22volume-a113fdd6-1fae-452e-89ef-e498da4721d8.88970c4e-46d9-4632-b9d1-bc523b3e96cb.vhdx%22,%20%22volume_id%22:%20%22a113fdd6-1fae-452e-89ef-e498da4721d8%22%7D => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:54:47.747802 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-74e70d8d-7c95-41a9-afe5-7232b576b9cd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:47.748412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-74e70d8d-7c95-41a9-afe5-7232b576b9cd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:47.748672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-07930c0d-88ec-4fca-8ca2-71b9c1b7d4a2 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:47.749436 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-07930c0d-88ec-4fca-8ca2-71b9c1b7d4a2 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:47.755888 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-07930c0d-88ec-4fca-8ca2-71b9c1b7d4a2 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:47.756379 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-07930c0d-88ec-4fca-8ca2-71b9c1b7d4a2 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:47.756841 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-07930c0d-88ec-4fca-8ca2-71b9c1b7d4a2 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:47.757067 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-74e70d8d-7c95-41a9-afe5-7232b576b9cd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:47.757540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-07930c0d-88ec-4fca-8ca2-71b9c1b7d4a2 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:47.757766 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-74e70d8d-7c95-41a9-afe5-7232b576b9cd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:47.758054 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-07930c0d-88ec-4fca-8ca2-71b9c1b7d4a2 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:47.758385 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-74e70d8d-7c95-41a9-afe5-7232b576b9cd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:47.758502 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-07930c0d-88ec-4fca-8ca2-71b9c1b7d4a2 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:47.759371 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-74e70d8d-7c95-41a9-afe5-7232b576b9cd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:47.759998 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-74e70d8d-7c95-41a9-afe5-7232b576b9cd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:47.760514 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-74e70d8d-7c95-41a9-afe5-7232b576b9cd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:47.833249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-74e70d8d-7c95-41a9-afe5-7232b576b9cd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:47.842837 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-07930c0d-88ec-4fca-8ca2-71b9c1b7d4a2 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:47.844724 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-74e70d8d-7c95-41a9-afe5-7232b576b9cd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1311 microversion: 2.1 time: 0.100458 Aug 29 21:54:47.845351 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 288/584] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:47 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:47.855182 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-07930c0d-88ec-4fca-8ca2-71b9c1b7d4a2 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1298 microversion: 2.1 time: 0.110346 Aug 29 21:54:47.855922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 297/585] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:47 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:54:48.303031 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:48.307708 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:48.310218 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:48.310714 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:48.311153 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:48.311856 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:48.312317 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:48.312774 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:48.344517 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:48.345039 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:48.345482 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:48.345935 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lazy-loading 'fault' on Instance uuid 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:54:48.387485 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:48.395754 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:48.397260 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:48.399027 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a43cedda-0c48-4d13-b050-79c94a8093cd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 200 len: 1371 microversion: 2.20 time: 0.100464 Aug 29 21:54:48.399593 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 289/586] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:54:48 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:54:48.866762 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-216bd40f-8163-4a41-9e17-fb8d153ca735 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:48.868158 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-216bd40f-8163-4a41-9e17-fb8d153ca735 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:48.875265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-216bd40f-8163-4a41-9e17-fb8d153ca735 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:48.877014 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-216bd40f-8163-4a41-9e17-fb8d153ca735 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:48.877014 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-216bd40f-8163-4a41-9e17-fb8d153ca735 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:48.877412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-be23feb7-ea1a-45da-a3ba-53f25943e11d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:48.878187 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-216bd40f-8163-4a41-9e17-fb8d153ca735 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:48.878363 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-be23feb7-ea1a-45da-a3ba-53f25943e11d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:48.878540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-216bd40f-8163-4a41-9e17-fb8d153ca735 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:48.878775 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-216bd40f-8163-4a41-9e17-fb8d153ca735 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:48.885046 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be23feb7-ea1a-45da-a3ba-53f25943e11d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:48.885540 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be23feb7-ea1a-45da-a3ba-53f25943e11d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:48.885978 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be23feb7-ea1a-45da-a3ba-53f25943e11d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:48.886697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be23feb7-ea1a-45da-a3ba-53f25943e11d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:48.887154 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be23feb7-ea1a-45da-a3ba-53f25943e11d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:48.887576 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be23feb7-ea1a-45da-a3ba-53f25943e11d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:48.924469 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be23feb7-ea1a-45da-a3ba-53f25943e11d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:48.924974 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be23feb7-ea1a-45da-a3ba-53f25943e11d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:48.925417 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be23feb7-ea1a-45da-a3ba-53f25943e11d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:48.925872 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-be23feb7-ea1a-45da-a3ba-53f25943e11d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lazy-loading 'fault' on Instance uuid bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:54:48.950548 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-216bd40f-8163-4a41-9e17-fb8d153ca735 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:48.959829 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-216bd40f-8163-4a41-9e17-fb8d153ca735 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1311 microversion: 2.1 time: 0.097605 Aug 29 21:54:48.960425 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 298/587] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:48 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:48.988789 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-be23feb7-ea1a-45da-a3ba-53f25943e11d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:48.997397 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-be23feb7-ea1a-45da-a3ba-53f25943e11d tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1303 microversion: 2.1 time: 0.124572 Aug 29 21:54:48.997974 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 290/588] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:48 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:54:49.422011 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-90de86dd-0568-43f3-b7a2-c4b9510d0d73 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:49.422531 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-90de86dd-0568-43f3-b7a2-c4b9510d0d73 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:49.428941 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-90de86dd-0568-43f3-b7a2-c4b9510d0d73 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:49.429461 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-90de86dd-0568-43f3-b7a2-c4b9510d0d73 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:49.429899 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-90de86dd-0568-43f3-b7a2-c4b9510d0d73 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:49.430619 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-90de86dd-0568-43f3-b7a2-c4b9510d0d73 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:49.431080 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-90de86dd-0568-43f3-b7a2-c4b9510d0d73 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:49.431503 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-90de86dd-0568-43f3-b7a2-c4b9510d0d73 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:49.446749 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-90de86dd-0568-43f3-b7a2-c4b9510d0d73 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] HTTP exception thrown: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-90de86dd-0568-43f3-b7a2-c4b9510d0d73 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Request method failure captured: Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f HTTP/1.1 Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTSszBLoeCq5sEX64Blc8btbeM2FEgGCul8XtuGultVF6_zKbAfkcA1RD5X_RNPicnb2BQXKgwqOSiR04TnNg7So-l_WPObZs6JUi3Ju3WwNhJaJ2Hw9FpaKlPP4JRSWhX28-2kKHRhffWhKl3PZFR20ZH-V_QE0-kKfAbdBBWVk7EU Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 754af1c2cd154e91ad9ecbee3ce04d0d Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:54:49.448438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:54:49.451491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:54:49.451491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:54:49.451491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 754af1c2cd154e91ad9ecbee3ce04d0d Aug 29 21:54:49.451491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:54:49.451491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeShelveTestJSON-1569171829-project Aug 29 21:54:49.451491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:54:49.451491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:54:49.451491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: fb465b4782514e7d8e75a7dc14c0a1e7 Aug 29 21:54:49.451491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1569171829-project Aug 29 21:54:49.451491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:54:49.451491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. Aug 29 21:54:49.451491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '9e60ebcd-98c1-4442-9c72-f4d9760c8d6f'} Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:54:49.453375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. Aug 29 21:54:49.456228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:54:49.459154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-90de86dd-0568-43f3-b7a2-c4b9510d0d73 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Returning 404 to user: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:54:49.459154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-90de86dd-0568-43f3-b7a2-c4b9510d0d73 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 404 len: 111 microversion: 2.20 time: 0.032386 Aug 29 21:54:49.459154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 299/589] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:54:49 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:54:49.459618 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2722dc77-d267-45c2-8e93-c5e6c2431331 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '.version_select at 0x7f50405f7940>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:49.564110 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2722dc77-d267-45c2-8e93-c5e6c2431331 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-329749883" status: 204 len: 0 microversion: 2.20 time: 0.108775 Aug 29 21:54:49.564790 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 291/590] 10.222.0.83 () {60 vars in 1259 bytes} [Mon Aug 29 21:54:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-329749883 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 21:54:49.983337 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b9d3e163-ebfe-44f9-8ffc-1006b015da9f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:49.983961 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b9d3e163-ebfe-44f9-8ffc-1006b015da9f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:49.990365 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b9d3e163-ebfe-44f9-8ffc-1006b015da9f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:49.990840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b9d3e163-ebfe-44f9-8ffc-1006b015da9f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:49.991282 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b9d3e163-ebfe-44f9-8ffc-1006b015da9f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:49.992704 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b9d3e163-ebfe-44f9-8ffc-1006b015da9f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:49.993166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b9d3e163-ebfe-44f9-8ffc-1006b015da9f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:49.993762 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b9d3e163-ebfe-44f9-8ffc-1006b015da9f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:50.026975 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-41bc8de9-3cdb-4312-b017-1264ddddb9d3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:50.028427 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-41bc8de9-3cdb-4312-b017-1264ddddb9d3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:50.040755 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41bc8de9-3cdb-4312-b017-1264ddddb9d3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:50.041823 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41bc8de9-3cdb-4312-b017-1264ddddb9d3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:50.042735 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41bc8de9-3cdb-4312-b017-1264ddddb9d3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:50.047066 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41bc8de9-3cdb-4312-b017-1264ddddb9d3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:50.048298 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41bc8de9-3cdb-4312-b017-1264ddddb9d3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:50.050012 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41bc8de9-3cdb-4312-b017-1264ddddb9d3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:50.093659 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b9d3e163-ebfe-44f9-8ffc-1006b015da9f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:50.102982 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b9d3e163-ebfe-44f9-8ffc-1006b015da9f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1311 microversion: 2.1 time: 0.123752 Aug 29 21:54:50.106185 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41bc8de9-3cdb-4312-b017-1264ddddb9d3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:50.106919 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41bc8de9-3cdb-4312-b017-1264ddddb9d3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:50.107679 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-41bc8de9-3cdb-4312-b017-1264ddddb9d3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:50.108470 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-41bc8de9-3cdb-4312-b017-1264ddddb9d3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lazy-loading 'fault' on Instance uuid bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:54:50.117380 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 300/591] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:49 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1311 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:50.169542 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-41bc8de9-3cdb-4312-b017-1264ddddb9d3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:50.178166 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-41bc8de9-3cdb-4312-b017-1264ddddb9d3 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1303 microversion: 2.1 time: 0.162800 Aug 29 21:54:50.181967 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 292/592] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:50 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1303 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:50.508838 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-7129368a-40fb-4569-b9e2-50fae9427525 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Action: 'create', calling method: .version_select at 0x7f5040700b80>, body: {"keypair": {"name": "tempest-keypair-1560396454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0oVIP4CURcGj/SCnIUfrfLIZd739WlCGZOin0wfd7nHAyUHgE6AXj/ofdIOArYRPiXknHmBYBbVmiPsMCf8ngflGyJol3maO1UDiYdSS9cEH4g1wOIAvDojUYIXq/3BQ=="}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:50.534654 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-7129368a-40fb-4569-b9e2-50fae9427525 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Getting quotas for project 754af1c2cd154e91ad9ecbee3ce04d0d. Resources: {'key_pairs'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:54:50.538795 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-7129368a-40fb-4569-b9e2-50fae9427525 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Getting quotas for user fb465b4782514e7d8e75a7dc14c0a1e7 and project 754af1c2cd154e91ad9ecbee3ce04d0d. Resources: {'key_pairs'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:54:50.551987 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7129368a-40fb-4569-b9e2-50fae9427525 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [5390ac31-a47d-4e65-a7e1-1e7a62384f5f] AMQP server on 10.222.0.83:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 29 21:54:51.125449 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d98188ed-c041-4539-8221-2675e2b7f4a2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:51.126088 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d98188ed-c041-4539-8221-2675e2b7f4a2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:51.132710 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d98188ed-c041-4539-8221-2675e2b7f4a2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:51.133208 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d98188ed-c041-4539-8221-2675e2b7f4a2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:51.133674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d98188ed-c041-4539-8221-2675e2b7f4a2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:51.134385 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d98188ed-c041-4539-8221-2675e2b7f4a2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:51.134957 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d98188ed-c041-4539-8221-2675e2b7f4a2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:51.135642 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d98188ed-c041-4539-8221-2675e2b7f4a2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:51.204501 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d98188ed-c041-4539-8221-2675e2b7f4a2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:51.212664 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d98188ed-c041-4539-8221-2675e2b7f4a2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1319 microversion: 2.1 time: 0.091193 Aug 29 21:54:51.213266 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 293/593] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:51 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1319 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:54:51.232456 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2b2982b7-fae5-4022-85c5-3a34856bbcfd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:51.233514 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2b2982b7-fae5-4022-85c5-3a34856bbcfd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:51.240348 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b2982b7-fae5-4022-85c5-3a34856bbcfd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:51.240930 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b2982b7-fae5-4022-85c5-3a34856bbcfd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:51.241378 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b2982b7-fae5-4022-85c5-3a34856bbcfd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:51.242691 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b2982b7-fae5-4022-85c5-3a34856bbcfd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:51.243167 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b2982b7-fae5-4022-85c5-3a34856bbcfd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:51.243594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b2982b7-fae5-4022-85c5-3a34856bbcfd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:51.282204 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b2982b7-fae5-4022-85c5-3a34856bbcfd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:51.282719 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b2982b7-fae5-4022-85c5-3a34856bbcfd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:51.283158 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b2982b7-fae5-4022-85c5-3a34856bbcfd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:51.284958 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-2b2982b7-fae5-4022-85c5-3a34856bbcfd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lazy-loading 'fault' on Instance uuid bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:54:51.331205 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2b2982b7-fae5-4022-85c5-3a34856bbcfd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8fa0892fe4f37b6ba6b3cf70506a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914dca3de66e476bb9a73c0e7fe97188', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:51.343428 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2b2982b7-fae5-4022-85c5-3a34856bbcfd tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 200 len: 1303 microversion: 2.1 time: 0.114903 Aug 29 21:54:51.344347 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 294/594] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:51 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:51.420811 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8a944ed4-2ca7-4e7f-8013-bb096b5cbc06 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:51.421572 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-8a944ed4-2ca7-4e7f-8013-bb096b5cbc06 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:51.427904 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a944ed4-2ca7-4e7f-8013-bb096b5cbc06 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:51.428393 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a944ed4-2ca7-4e7f-8013-bb096b5cbc06 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:51.428888 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a944ed4-2ca7-4e7f-8013-bb096b5cbc06 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:51.429674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a944ed4-2ca7-4e7f-8013-bb096b5cbc06 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:51.430129 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a944ed4-2ca7-4e7f-8013-bb096b5cbc06 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:51.430550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a944ed4-2ca7-4e7f-8013-bb096b5cbc06 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:51.569134 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-8a944ed4-2ca7-4e7f-8013-bb096b5cbc06 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lazy-loading 'services' on Instance uuid 3f59fdcb-151b-40d2-befd-7114b5ac5c89 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:54:51.571756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO oslo.messaging._drivers.impl_rabbit [None req-7129368a-40fb-4569-b9e2-50fae9427525 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [5390ac31-a47d-4e65-a7e1-1e7a62384f5f] Reconnected to AMQP server on 10.222.0.83:5672 via [amqp] client with port 45688. Aug 29 21:54:51.654109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-7129368a-40fb-4569-b9e2-50fae9427525 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.158265 Aug 29 21:54:51.659526 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 301/595] 10.222.0.83 () {62 vars in 1200 bytes} [Mon Aug 29 21:54:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1161 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 21:54:51.873239 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=4 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:51.875296 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-8a944ed4-2ca7-4e7f-8013-bb096b5cbc06 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "DELETE /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89/os-volume_attachments/a113fdd6-1fae-452e-89ef-e498da4721d8" status: 202 len: 0 microversion: 2.1 time: 0.460126 Aug 29 21:54:51.875906 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 295/596] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 21:54:51 2022] DELETE /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89/os-volume_attachments/a113fdd6-1fae-452e-89ef-e498da4721d8 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:54:52.246072 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-fc3f8f75-30cb-4ebc-959f-c8a31be7cfb0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:52.246897 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-fc3f8f75-30cb-4ebc-959f-c8a31be7cfb0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:52.260017 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc3f8f75-30cb-4ebc-959f-c8a31be7cfb0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:52.260017 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc3f8f75-30cb-4ebc-959f-c8a31be7cfb0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:52.260017 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc3f8f75-30cb-4ebc-959f-c8a31be7cfb0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:52.260903 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc3f8f75-30cb-4ebc-959f-c8a31be7cfb0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:52.261486 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc3f8f75-30cb-4ebc-959f-c8a31be7cfb0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:52.261967 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fc3f8f75-30cb-4ebc-959f-c8a31be7cfb0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:52.425908 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=10 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:52.433100 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e28d29de-0a28-448b-8155-3cc5bbb4ff56 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:52.434113 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e28d29de-0a28-448b-8155-3cc5bbb4ff56 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] [instance: bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:52.442539 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e28d29de-0a28-448b-8155-3cc5bbb4ff56 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:52.443108 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e28d29de-0a28-448b-8155-3cc5bbb4ff56 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:52.443560 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e28d29de-0a28-448b-8155-3cc5bbb4ff56 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:52.444288 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e28d29de-0a28-448b-8155-3cc5bbb4ff56 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:52.444853 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e28d29de-0a28-448b-8155-3cc5bbb4ff56 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:52.445830 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e28d29de-0a28-448b-8155-3cc5bbb4ff56 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:52.463349 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-e28d29de-0a28-448b-8155-3cc5bbb4ff56 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] HTTP exception thrown: Instance bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 could not be found. Aug 29 21:54:52.464495 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-fc3f8f75-30cb-4ebc-959f-c8a31be7cfb0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e28d29de-0a28-448b-8155-3cc5bbb4ff56 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Request method failure captured: Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 HTTP/1.1 Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTVlLVSo3nf8QhYJrJ_2TtoiSXlFSVq0q_Kb2MbPwA8QZUIGfTN2PWvXksVhEDMT3GHVB57HnB1D6meM2daLABluRYsItAPiS-oBEmNBZ93N1V2qPeDfR7XokhEcccKDdTGhSbaj_fB_AOTg2oVK4Lv2gqxVjNnA_YmP6cbr9BDRXOo Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: 914dca3de66e476bb9a73c0e7fe97188 Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-VolumesActionsTest-1506380559 Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 21:54:52.465195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 21:54:52.467739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/914dca3de66e476bb9a73c0e7fe97188"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_914dca3de66e476bb9a73c0e7fe97188"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/914dca3de66e476bb9a73c0e7fe97188"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/914dca3de66e476bb9a73c0e7fe97188"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:54:52.467739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-VolumesActionsTest-1506380559 Aug 29 21:54:52.467739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: 914dca3de66e476bb9a73c0e7fe97188 Aug 29 21:54:52.467739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-VolumesActionsTest-1506380559 Aug 29 21:54:52.467739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-VolumesActionsTest-1506380559-project Aug 29 21:54:52.467739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 21:54:52.467739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 21:54:52.467739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: aae8fa0892fe4f37b6ba6b3cf70506a8 Aug 29 21:54:52.467739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-VolumesActionsTest-1506380559-project Aug 29 21:54:52.467739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 21:54:52.467739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 could not be found. Aug 29 21:54:52.467739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': 'bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3'} Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 could not be found. Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:54:52.469013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 could not be found. Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 could not be found. Aug 29 21:54:52.471477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:54:52.474239 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e28d29de-0a28-448b-8155-3cc5bbb4ff56 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] Returning 404 to user: Instance bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:54:52.474239 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e28d29de-0a28-448b-8155-3cc5bbb4ff56 tempest-VolumesActionsTest-1506380559 tempest-VolumesActionsTest-1506380559-project] 10.222.0.83 "GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3" status: 404 len: 111 microversion: 2.1 time: 0.042991 Aug 29 21:54:52.474743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-fc3f8f75-30cb-4ebc-959f-c8a31be7cfb0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.235147 Aug 29 21:54:52.487477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 302/597] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:52 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:52.487572 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 296/598] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:52 2022] GET /compute/v2.1/servers/bf61ef24-ac99-4dfa-8eef-abff4ebbd6a3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:54:53.506722 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b0f3966e-70fa-42d6-bb28-660315fce2ad tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:53.507893 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b0f3966e-70fa-42d6-bb28-660315fce2ad tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:53.522398 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b0f3966e-70fa-42d6-bb28-660315fce2ad tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:53.523502 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b0f3966e-70fa-42d6-bb28-660315fce2ad tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:53.525229 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b0f3966e-70fa-42d6-bb28-660315fce2ad tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:53.526861 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b0f3966e-70fa-42d6-bb28-660315fce2ad tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:53.527997 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b0f3966e-70fa-42d6-bb28-660315fce2ad tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:53.529165 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b0f3966e-70fa-42d6-bb28-660315fce2ad tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:53.755757 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b0f3966e-70fa-42d6-bb28-660315fce2ad tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:53.764949 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b0f3966e-70fa-42d6-bb28-660315fce2ad tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.272157 Aug 29 21:54:53.765538 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 303/599] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:53 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:54:54.814520 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-9a31d311-cb57-4a6a-9e0b-ea81c5eb7c5c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:54.819800 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-9a31d311-cb57-4a6a-9e0b-ea81c5eb7c5c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:54.825847 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9a31d311-cb57-4a6a-9e0b-ea81c5eb7c5c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:54.826961 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9a31d311-cb57-4a6a-9e0b-ea81c5eb7c5c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:54.827685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9a31d311-cb57-4a6a-9e0b-ea81c5eb7c5c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:54.829001 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9a31d311-cb57-4a6a-9e0b-ea81c5eb7c5c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:54.829688 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9a31d311-cb57-4a6a-9e0b-ea81c5eb7c5c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:54.830777 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9a31d311-cb57-4a6a-9e0b-ea81c5eb7c5c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:54.931533 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-456869960", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44c6fe50-f230-4cd8-8b13-2db7bc2daddd"}], "security_groups": [{"name": "tempest-securitygroup--1780199162"}], "key_name": "tempest-keypair-1560396454", "user_data": "}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:55.012098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9a31d311-cb57-4a6a-9e0b-ea81c5eb7c5c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:55.025072 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-9a31d311-cb57-4a6a-9e0b-ea81c5eb7c5c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.226095 Aug 29 21:54:55.026136 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 297/600] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:54 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:55.109912 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.network.neutron [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] validate_networks() for [('44c6fe50-f230-4cd8-8b13-2db7bc2daddd', None, None, None, None, None)] {{(pid=127882) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:54:55.960121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Flavor limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:54:55.961332 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Image limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:54:55.961761 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Flavor pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:54:55.962274 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Image pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:54:55.962802 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:54:55.998846 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:55.999747 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:56.000649 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:56.001703 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:56.004649 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:56.005277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:56.034372 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Getting quotas for project 754af1c2cd154e91ad9ecbee3ce04d0d. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:54:56.040957 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Getting quotas for user fb465b4782514e7d8e75a7dc14c0a1e7 and project 754af1c2cd154e91ad9ecbee3ce04d0d. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:54:56.050323 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b131a49d-b6f1-4bd4-968c-58324a5cf46b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:56.050845 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b131a49d-b6f1-4bd4-968c-58324a5cf46b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:56.060265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Going to run 1 instances... {{(pid=127882) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:54:56.067193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127882) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:54:56.070175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b131a49d-b6f1-4bd4-968c-58324a5cf46b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:56.070810 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b131a49d-b6f1-4bd4-968c-58324a5cf46b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:56.071390 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b131a49d-b6f1-4bd4-968c-58324a5cf46b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:56.074709 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b131a49d-b6f1-4bd4-968c-58324a5cf46b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:56.075213 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b131a49d-b6f1-4bd4-968c-58324a5cf46b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:56.075666 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b131a49d-b6f1-4bd4-968c-58324a5cf46b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:56.259191 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-91e4a0ac-b296-46d4-b4cc-d29250aebec5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.332390 Aug 29 21:54:56.264024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 304/601] 10.222.0.83 () {62 vars in 1188 bytes} [Mon Aug 29 21:54:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 21:54:56.269413 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-28a4ea08-7662-4e3f-b656-d2795abc4b63 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:56.282970 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-28a4ea08-7662-4e3f-b656-d2795abc4b63 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:56.313793 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-28a4ea08-7662-4e3f-b656-d2795abc4b63 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:56.316040 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-28a4ea08-7662-4e3f-b656-d2795abc4b63 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:56.316648 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-28a4ea08-7662-4e3f-b656-d2795abc4b63 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:56.325353 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-28a4ea08-7662-4e3f-b656-d2795abc4b63 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:56.326977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-28a4ea08-7662-4e3f-b656-d2795abc4b63 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:56.340916 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-28a4ea08-7662-4e3f-b656-d2795abc4b63 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:56.462397 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-28a4ea08-7662-4e3f-b656-d2795abc4b63 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.196837 Aug 29 21:54:56.469120 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 305/602] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 21:54:56 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601/os-volume_attachments => generated 25 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:54:56.488409 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0d808798-0297-4977-9c69-03f002efa660 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:56.489711 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-0d808798-0297-4977-9c69-03f002efa660 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:56.530392 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b131a49d-b6f1-4bd4-968c-58324a5cf46b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:56.539397 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b131a49d-b6f1-4bd4-968c-58324a5cf46b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.495359 Aug 29 21:54:56.543916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 298/603] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:56 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:56.607863 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-0d808798-0297-4977-9c69-03f002efa660 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:56.612678 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-5405595a-db14-4268-89f8-9eb677151b8d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:56.613343 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-5405595a-db14-4268-89f8-9eb677151b8d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:56.625893 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-0d808798-0297-4977-9c69-03f002efa660 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:56.627562 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-0d808798-0297-4977-9c69-03f002efa660 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:56.628261 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5405595a-db14-4268-89f8-9eb677151b8d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:56.629465 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5405595a-db14-4268-89f8-9eb677151b8d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:56.629465 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5405595a-db14-4268-89f8-9eb677151b8d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:56.630943 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-0d808798-0297-4977-9c69-03f002efa660 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1281 microversion: 2.20 time: 0.151475 Aug 29 21:54:56.631777 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5405595a-db14-4268-89f8-9eb677151b8d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:56.633132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5405595a-db14-4268-89f8-9eb677151b8d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:56.633658 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 306/604] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:54:56 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1281 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:54:56.634226 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5405595a-db14-4268-89f8-9eb677151b8d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:56.688963 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-5405595a-db14-4268-89f8-9eb677151b8d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Going to try to terminate instance {{(pid=127883) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:54:57.086288 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-5405595a-db14-4268-89f8-9eb677151b8d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "DELETE /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 204 len: 0 microversion: 2.1 time: 0.486343 Aug 29 21:54:57.096412 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0a1b23c1-c2f8-4354-a6ad-bbae9d561c1c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:57.097191 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 299/605] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:54:56 2022] DELETE /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:54:57.098154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-0a1b23c1-c2f8-4354-a6ad-bbae9d561c1c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:57.121159 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0a1b23c1-c2f8-4354-a6ad-bbae9d561c1c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:57.122050 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0a1b23c1-c2f8-4354-a6ad-bbae9d561c1c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:57.122818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0a1b23c1-c2f8-4354-a6ad-bbae9d561c1c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:57.123825 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0a1b23c1-c2f8-4354-a6ad-bbae9d561c1c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:57.124559 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0a1b23c1-c2f8-4354-a6ad-bbae9d561c1c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:57.125213 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0a1b23c1-c2f8-4354-a6ad-bbae9d561c1c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:57.568106 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-0a1b23c1-c2f8-4354-a6ad-bbae9d561c1c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:57.586047 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-5720f5d3-83e6-4a00-961a-f68b6bae2897 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:57.586847 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-5720f5d3-83e6-4a00-961a-f68b6bae2897 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:57.590103 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=100 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:57.602349 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-0a1b23c1-c2f8-4354-a6ad-bbae9d561c1c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1672 microversion: 2.1 time: 0.508797 Aug 29 21:54:57.603716 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5720f5d3-83e6-4a00-961a-f68b6bae2897 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:57.604165 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 307/606] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:57 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1672 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:57.608366 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5720f5d3-83e6-4a00-961a-f68b6bae2897 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:57.609122 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5720f5d3-83e6-4a00-961a-f68b6bae2897 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:57.624659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5720f5d3-83e6-4a00-961a-f68b6bae2897 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:57.624659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5720f5d3-83e6-4a00-961a-f68b6bae2897 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:57.624659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5720f5d3-83e6-4a00-961a-f68b6bae2897 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:57.628546 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-7908647c-d2ea-4bed-a01b-a10492856420 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:57.631615 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-7908647c-d2ea-4bed-a01b-a10492856420 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:57.648164 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7908647c-d2ea-4bed-a01b-a10492856420 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:57.649034 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7908647c-d2ea-4bed-a01b-a10492856420 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:57.649676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7908647c-d2ea-4bed-a01b-a10492856420 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:57.653462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7908647c-d2ea-4bed-a01b-a10492856420 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:57.654219 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7908647c-d2ea-4bed-a01b-a10492856420 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:57.657959 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7908647c-d2ea-4bed-a01b-a10492856420 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:57.678840 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:57.723285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-7908647c-d2ea-4bed-a01b-a10492856420 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Going to try to terminate instance {{(pid=127882) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:54:57.956300 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-5720f5d3-83e6-4a00-961a-f68b6bae2897 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:57.973118 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-5720f5d3-83e6-4a00-961a-f68b6bae2897 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.404782 Aug 29 21:54:57.974177 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 300/607] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:57 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:54:57.982177 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b3c8dd09-0bbd-462e-abeb-c7022fa8d6f4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:57.989233 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b3c8dd09-0bbd-462e-abeb-c7022fa8d6f4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:58.000563 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b3c8dd09-0bbd-462e-abeb-c7022fa8d6f4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:58.001131 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b3c8dd09-0bbd-462e-abeb-c7022fa8d6f4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:58.001606 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b3c8dd09-0bbd-462e-abeb-c7022fa8d6f4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:58.002326 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b3c8dd09-0bbd-462e-abeb-c7022fa8d6f4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:58.002815 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b3c8dd09-0bbd-462e-abeb-c7022fa8d6f4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:58.003241 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b3c8dd09-0bbd-462e-abeb-c7022fa8d6f4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:58.102753 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b3c8dd09-0bbd-462e-abeb-c7022fa8d6f4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:58.118623 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b3c8dd09-0bbd-462e-abeb-c7022fa8d6f4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:58.120909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b3c8dd09-0bbd-462e-abeb-c7022fa8d6f4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:58.123843 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b3c8dd09-0bbd-462e-abeb-c7022fa8d6f4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1285 microversion: 2.20 time: 0.148169 Aug 29 21:54:58.125345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 301/608] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:54:57 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:54:58.638917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7f549c1a-7da5-4dbc-879c-b43ec3019fc9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:58.640027 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7f549c1a-7da5-4dbc-879c-b43ec3019fc9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:58.649190 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7f549c1a-7da5-4dbc-879c-b43ec3019fc9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:58.652085 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7f549c1a-7da5-4dbc-879c-b43ec3019fc9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:58.652983 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7f549c1a-7da5-4dbc-879c-b43ec3019fc9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:58.654363 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7f549c1a-7da5-4dbc-879c-b43ec3019fc9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:58.655272 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7f549c1a-7da5-4dbc-879c-b43ec3019fc9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:58.656025 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7f549c1a-7da5-4dbc-879c-b43ec3019fc9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:58.831349 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:58.899172 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-7908647c-d2ea-4bed-a01b-a10492856420 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "DELETE /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 204 len: 0 microversion: 2.1 time: 1.291044 Aug 29 21:54:58.900248 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 308/609] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:54:57 2022] DELETE /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 0 bytes in 1294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:54:58.912229 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-85052184-07e4-4165-b3f1-718d3f18eba4 req-78bb0b39-e58f-48de-a7c9-28ec3e1f0f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9b91c1-cfde-4d81-ac00-b83f8b333df9", "tag": "b88a29b5-ab90-482e-8b10-2c1389ed5c8b"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:54:58.916566 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7f549c1a-7da5-4dbc-879c-b43ec3019fc9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:58.926594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7f549c1a-7da5-4dbc-879c-b43ec3019fc9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1672 microversion: 2.1 time: 0.292119 Aug 29 21:54:58.927595 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 302/610] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:58 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1672 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:54:58.935072 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-79cd29f2-73af-4abe-9764-50a6493ff621 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:58.939541 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-79cd29f2-73af-4abe-9764-50a6493ff621 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:58.946234 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-85052184-07e4-4165-b3f1-718d3f18eba4 req-78bb0b39-e58f-48de-a7c9-28ec3e1f0f00 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:58.947025 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-85052184-07e4-4165-b3f1-718d3f18eba4 req-78bb0b39-e58f-48de-a7c9-28ec3e1f0f00 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:58.947688 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-85052184-07e4-4165-b3f1-718d3f18eba4 req-78bb0b39-e58f-48de-a7c9-28ec3e1f0f00 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:58.957442 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79cd29f2-73af-4abe-9764-50a6493ff621 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:58.958306 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79cd29f2-73af-4abe-9764-50a6493ff621 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:58.958775 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79cd29f2-73af-4abe-9764-50a6493ff621 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:58.959537 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79cd29f2-73af-4abe-9764-50a6493ff621 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:58.960068 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79cd29f2-73af-4abe-9764-50a6493ff621 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:58.960668 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79cd29f2-73af-4abe-9764-50a6493ff621 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:58.963812 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-85052184-07e4-4165-b3f1-718d3f18eba4 req-78bb0b39-e58f-48de-a7c9-28ec3e1f0f00 service nova] Creating event network-changed:b88a29b5-ab90-482e-8b10-2c1389ed5c8b for instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 on hv-cinder-85426 Aug 29 21:54:58.971886 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-85052184-07e4-4165-b3f1-718d3f18eba4 req-78bb0b39-e58f-48de-a7c9-28ec3e1f0f00 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069381 Aug 29 21:54:58.974828 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 309/611] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:54:58.998052 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-af832654-7c6b-4d94-9d27-958ef519e520 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:58.999091 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-af832654-7c6b-4d94-9d27-958ef519e520 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:59.005616 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-af832654-7c6b-4d94-9d27-958ef519e520 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:59.006119 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-af832654-7c6b-4d94-9d27-958ef519e520 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:59.006567 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-af832654-7c6b-4d94-9d27-958ef519e520 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:59.007823 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-af832654-7c6b-4d94-9d27-958ef519e520 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:59.008299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-af832654-7c6b-4d94-9d27-958ef519e520 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:59.008748 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-af832654-7c6b-4d94-9d27-958ef519e520 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:59.127384 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-79cd29f2-73af-4abe-9764-50a6493ff621 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:59.152931 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-79cd29f2-73af-4abe-9764-50a6493ff621 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1559 microversion: 2.1 time: 0.224076 Aug 29 21:54:59.166962 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-af832654-7c6b-4d94-9d27-958ef519e520 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:59.167126 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 303/612] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:58 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1559 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:59.175101 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6dba3581-e402-4971-8863-a3e33a445ae8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:59.176168 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6dba3581-e402-4971-8863-a3e33a445ae8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:59.178775 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-af832654-7c6b-4d94-9d27-958ef519e520 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.183712 Aug 29 21:54:59.180676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 310/613] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:58 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:54:59.184174 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6dba3581-e402-4971-8863-a3e33a445ae8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:59.184732 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6dba3581-e402-4971-8863-a3e33a445ae8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:59.185411 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6dba3581-e402-4971-8863-a3e33a445ae8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:59.186372 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6dba3581-e402-4971-8863-a3e33a445ae8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:59.186794 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6dba3581-e402-4971-8863-a3e33a445ae8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:59.187438 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6dba3581-e402-4971-8863-a3e33a445ae8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:59.260869 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6dba3581-e402-4971-8863-a3e33a445ae8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:59.270047 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6dba3581-e402-4971-8863-a3e33a445ae8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:59.271954 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6dba3581-e402-4971-8863-a3e33a445ae8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:54:59.274224 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6dba3581-e402-4971-8863-a3e33a445ae8 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1285 microversion: 2.20 time: 0.105815 Aug 29 21:54:59.274893 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 304/614] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:54:59 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:54:59.960335 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-3663d7e4-c7eb-4e09-ade9-63fb2c18c9db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:54:59.962562 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3663d7e4-c7eb-4e09-ade9-63fb2c18c9db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:54:59.984022 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3663d7e4-c7eb-4e09-ade9-63fb2c18c9db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:59.986316 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3663d7e4-c7eb-4e09-ade9-63fb2c18c9db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:59.987889 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3663d7e4-c7eb-4e09-ade9-63fb2c18c9db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:54:59.989961 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3663d7e4-c7eb-4e09-ade9-63fb2c18c9db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:54:59.992179 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3663d7e4-c7eb-4e09-ade9-63fb2c18c9db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:54:59.994109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3663d7e4-c7eb-4e09-ade9-63fb2c18c9db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:00.219748 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-98f89a0f-c974-4222-8f99-c6ca4f68c1c9 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:00.221363 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-98f89a0f-c974-4222-8f99-c6ca4f68c1c9 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:00.249444 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-98f89a0f-c974-4222-8f99-c6ca4f68c1c9 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:00.255094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-98f89a0f-c974-4222-8f99-c6ca4f68c1c9 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:00.255094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-98f89a0f-c974-4222-8f99-c6ca4f68c1c9 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:00.255094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-98f89a0f-c974-4222-8f99-c6ca4f68c1c9 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:00.255094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-98f89a0f-c974-4222-8f99-c6ca4f68c1c9 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:00.255542 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-98f89a0f-c974-4222-8f99-c6ca4f68c1c9 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:00.353906 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-3663d7e4-c7eb-4e09-ade9-63fb2c18c9db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:00.379554 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-3663d7e4-c7eb-4e09-ade9-63fb2c18c9db tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1672 microversion: 2.1 time: 0.432171 Aug 29 21:55:00.393000 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 311/615] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:54:59 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1672 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:00.406231 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-202609f1-0a10-4e91-9ba7-a84afa7d1e2d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:00.406863 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-202609f1-0a10-4e91-9ba7-a84afa7d1e2d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:00.413385 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-202609f1-0a10-4e91-9ba7-a84afa7d1e2d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:00.414910 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-202609f1-0a10-4e91-9ba7-a84afa7d1e2d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:00.415357 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-202609f1-0a10-4e91-9ba7-a84afa7d1e2d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:00.416119 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-202609f1-0a10-4e91-9ba7-a84afa7d1e2d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:00.416612 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-202609f1-0a10-4e91-9ba7-a84afa7d1e2d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:00.417295 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-202609f1-0a10-4e91-9ba7-a84afa7d1e2d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:00.540677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-98f89a0f-c974-4222-8f99-c6ca4f68c1c9 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:00.551884 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-98f89a0f-c974-4222-8f99-c6ca4f68c1c9 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1559 microversion: 2.1 time: 0.366159 Aug 29 21:55:00.557445 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 305/616] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:00 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1559 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:00.573023 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b5ad29f2-b42f-4eef-bdfc-0fcdce9be189 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:00.573866 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b5ad29f2-b42f-4eef-bdfc-0fcdce9be189 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:00.589500 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b5ad29f2-b42f-4eef-bdfc-0fcdce9be189 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:00.590300 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b5ad29f2-b42f-4eef-bdfc-0fcdce9be189 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:00.590922 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b5ad29f2-b42f-4eef-bdfc-0fcdce9be189 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:00.591848 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b5ad29f2-b42f-4eef-bdfc-0fcdce9be189 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:00.592507 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b5ad29f2-b42f-4eef-bdfc-0fcdce9be189 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:00.593119 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b5ad29f2-b42f-4eef-bdfc-0fcdce9be189 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:00.685799 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-202609f1-0a10-4e91-9ba7-a84afa7d1e2d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:00.698443 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-202609f1-0a10-4e91-9ba7-a84afa7d1e2d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.303963 Aug 29 21:55:00.705129 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 312/617] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:00 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:00.754274 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b5ad29f2-b42f-4eef-bdfc-0fcdce9be189 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:00.771509 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b5ad29f2-b42f-4eef-bdfc-0fcdce9be189 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:00.779323 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b5ad29f2-b42f-4eef-bdfc-0fcdce9be189 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:00.781186 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b5ad29f2-b42f-4eef-bdfc-0fcdce9be189 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1285 microversion: 2.20 time: 0.222428 Aug 29 21:55:00.782652 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 306/618] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:00 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1285 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:01.485690 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-8059fbf7-3fc9-412b-81ac-71221ace54f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:01.490831 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-8059fbf7-3fc9-412b-81ac-71221ace54f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:01.539679 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8059fbf7-3fc9-412b-81ac-71221ace54f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:01.539679 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8059fbf7-3fc9-412b-81ac-71221ace54f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:01.539679 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8059fbf7-3fc9-412b-81ac-71221ace54f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:01.539679 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8059fbf7-3fc9-412b-81ac-71221ace54f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:01.573165 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8059fbf7-3fc9-412b-81ac-71221ace54f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:01.573165 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8059fbf7-3fc9-412b-81ac-71221ace54f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:01.636465 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d6d5b1b4-7098-4c79-a23d-7212b0ecabab tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:01.639252 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d6d5b1b4-7098-4c79-a23d-7212b0ecabab tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:01.660697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d6d5b1b4-7098-4c79-a23d-7212b0ecabab tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:01.662552 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d6d5b1b4-7098-4c79-a23d-7212b0ecabab tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:01.665056 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d6d5b1b4-7098-4c79-a23d-7212b0ecabab tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:01.666470 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d6d5b1b4-7098-4c79-a23d-7212b0ecabab tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:01.667404 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d6d5b1b4-7098-4c79-a23d-7212b0ecabab tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:01.668193 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d6d5b1b4-7098-4c79-a23d-7212b0ecabab tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:01.874729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-8059fbf7-3fc9-412b-81ac-71221ace54f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:01.895939 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-8059fbf7-3fc9-412b-81ac-71221ace54f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1672 microversion: 2.1 time: 0.421586 Aug 29 21:55:01.895939 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 313/619] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:01 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1672 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:01.901260 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e1c86993-7880-4a81-a2d5-0897e0ef9feb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:01.902841 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-e1c86993-7880-4a81-a2d5-0897e0ef9feb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:01.910886 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e1c86993-7880-4a81-a2d5-0897e0ef9feb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:01.911800 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e1c86993-7880-4a81-a2d5-0897e0ef9feb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:01.912392 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e1c86993-7880-4a81-a2d5-0897e0ef9feb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:01.913450 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e1c86993-7880-4a81-a2d5-0897e0ef9feb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:01.914681 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e1c86993-7880-4a81-a2d5-0897e0ef9feb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:01.915276 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e1c86993-7880-4a81-a2d5-0897e0ef9feb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:02.142581 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d6d5b1b4-7098-4c79-a23d-7212b0ecabab tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:02.157578 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d6d5b1b4-7098-4c79-a23d-7212b0ecabab tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1513 microversion: 2.1 time: 0.539080 Aug 29 21:55:02.164934 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e1c86993-7880-4a81-a2d5-0897e0ef9feb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:02.173653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 307/620] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:01 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1513 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:02.179063 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e1c86993-7880-4a81-a2d5-0897e0ef9feb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.283749 Aug 29 21:55:02.197650 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 314/621] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:01 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:02.198841 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e099ea99-a6e7-453f-82e9-792d4bff8adf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:02.200236 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e099ea99-a6e7-453f-82e9-792d4bff8adf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:02.207350 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e099ea99-a6e7-453f-82e9-792d4bff8adf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:02.213396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e099ea99-a6e7-453f-82e9-792d4bff8adf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:02.213396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e099ea99-a6e7-453f-82e9-792d4bff8adf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:02.213396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e099ea99-a6e7-453f-82e9-792d4bff8adf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:02.213396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e099ea99-a6e7-453f-82e9-792d4bff8adf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:02.213828 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e099ea99-a6e7-453f-82e9-792d4bff8adf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:02.323952 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e099ea99-a6e7-453f-82e9-792d4bff8adf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:02.355040 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e099ea99-a6e7-453f-82e9-792d4bff8adf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:02.358168 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e099ea99-a6e7-453f-82e9-792d4bff8adf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:02.364861 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e099ea99-a6e7-453f-82e9-792d4bff8adf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1285 microversion: 2.20 time: 0.187507 Aug 29 21:55:02.365936 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 308/622] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:02 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:02.926664 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-10143b18-d578-4617-bb1c-f91a4cf574f4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:02.934161 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-10143b18-d578-4617-bb1c-f91a4cf574f4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:02.959774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10143b18-d578-4617-bb1c-f91a4cf574f4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:02.961556 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10143b18-d578-4617-bb1c-f91a4cf574f4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:02.962616 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10143b18-d578-4617-bb1c-f91a4cf574f4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:02.964140 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10143b18-d578-4617-bb1c-f91a4cf574f4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:02.970692 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10143b18-d578-4617-bb1c-f91a4cf574f4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:02.971365 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-10143b18-d578-4617-bb1c-f91a4cf574f4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:03.188313 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-70365690-14f6-4d0f-83f2-a69a4d6cb4e4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:03.193262 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-70365690-14f6-4d0f-83f2-a69a4d6cb4e4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:03.201406 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-70365690-14f6-4d0f-83f2-a69a4d6cb4e4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:03.206086 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-70365690-14f6-4d0f-83f2-a69a4d6cb4e4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:03.207141 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-70365690-14f6-4d0f-83f2-a69a4d6cb4e4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:03.210027 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-70365690-14f6-4d0f-83f2-a69a4d6cb4e4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:03.210892 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-70365690-14f6-4d0f-83f2-a69a4d6cb4e4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:03.214490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-70365690-14f6-4d0f-83f2-a69a4d6cb4e4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:03.258460 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-10143b18-d578-4617-bb1c-f91a4cf574f4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:03.266432 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-10143b18-d578-4617-bb1c-f91a4cf574f4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1672 microversion: 2.1 time: 0.347985 Aug 29 21:55:03.271956 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 315/623] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:02 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1672 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:03.271956 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-1da22b4b-4972-49aa-ad28-b723f83d08cc tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:03.272286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-1da22b4b-4972-49aa-ad28-b723f83d08cc tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:03.278501 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1da22b4b-4972-49aa-ad28-b723f83d08cc tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:03.279998 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1da22b4b-4972-49aa-ad28-b723f83d08cc tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:03.279998 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1da22b4b-4972-49aa-ad28-b723f83d08cc tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:03.280210 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1da22b4b-4972-49aa-ad28-b723f83d08cc tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:03.280671 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1da22b4b-4972-49aa-ad28-b723f83d08cc tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:03.281106 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1da22b4b-4972-49aa-ad28-b723f83d08cc tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:03.412740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-70365690-14f6-4d0f-83f2-a69a4d6cb4e4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:03.422412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-70365690-14f6-4d0f-83f2-a69a4d6cb4e4 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1513 microversion: 2.1 time: 0.244218 Aug 29 21:55:03.423277 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 309/624] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:03 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:03.435001 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-491efedb-0ced-42e3-be84-a786edc3af83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:03.435001 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-491efedb-0ced-42e3-be84-a786edc3af83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:03.435001 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-491efedb-0ced-42e3-be84-a786edc3af83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:03.435753 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-491efedb-0ced-42e3-be84-a786edc3af83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:03.435753 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-491efedb-0ced-42e3-be84-a786edc3af83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:03.436386 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-491efedb-0ced-42e3-be84-a786edc3af83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:03.436906 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-491efedb-0ced-42e3-be84-a786edc3af83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:03.437340 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-491efedb-0ced-42e3-be84-a786edc3af83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:03.522291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1da22b4b-4972-49aa-ad28-b723f83d08cc tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:03.538572 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-1da22b4b-4972-49aa-ad28-b723f83d08cc tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.270317 Aug 29 21:55:03.540091 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 316/625] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:03 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:03.572759 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-491efedb-0ced-42e3-be84-a786edc3af83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:03.586165 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-491efedb-0ced-42e3-be84-a786edc3af83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:03.590925 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-491efedb-0ced-42e3-be84-a786edc3af83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:03.592880 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-491efedb-0ced-42e3-be84-a786edc3af83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1285 microversion: 2.20 time: 0.168569 Aug 29 21:55:03.593780 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 310/626] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:03 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:04.294864 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d504940f-b4eb-4fc1-a0d7-f0259042508b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:04.295891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d504940f-b4eb-4fc1-a0d7-f0259042508b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:04.314025 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d504940f-b4eb-4fc1-a0d7-f0259042508b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:04.316112 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d504940f-b4eb-4fc1-a0d7-f0259042508b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:04.317429 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d504940f-b4eb-4fc1-a0d7-f0259042508b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:04.318937 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d504940f-b4eb-4fc1-a0d7-f0259042508b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:04.320877 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d504940f-b4eb-4fc1-a0d7-f0259042508b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:04.322007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d504940f-b4eb-4fc1-a0d7-f0259042508b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:04.443324 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-353d60e3-4408-4884-8fa1-4d687457493f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:04.444676 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-353d60e3-4408-4884-8fa1-4d687457493f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:04.455798 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-353d60e3-4408-4884-8fa1-4d687457493f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:04.457957 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-353d60e3-4408-4884-8fa1-4d687457493f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:04.458814 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-353d60e3-4408-4884-8fa1-4d687457493f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:04.460117 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-353d60e3-4408-4884-8fa1-4d687457493f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:04.461690 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-353d60e3-4408-4884-8fa1-4d687457493f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:04.463328 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-353d60e3-4408-4884-8fa1-4d687457493f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:04.500765 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d504940f-b4eb-4fc1-a0d7-f0259042508b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:04.518229 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d504940f-b4eb-4fc1-a0d7-f0259042508b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1672 microversion: 2.1 time: 0.232587 Aug 29 21:55:04.520553 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 317/627] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:04 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1672 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:04.576094 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-56264547-c0c3-4cad-96f2-38e7c5d1ab03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:04.577042 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-56264547-c0c3-4cad-96f2-38e7c5d1ab03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:04.583847 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-56264547-c0c3-4cad-96f2-38e7c5d1ab03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:04.584366 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-56264547-c0c3-4cad-96f2-38e7c5d1ab03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:04.584865 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-56264547-c0c3-4cad-96f2-38e7c5d1ab03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:04.586021 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-56264547-c0c3-4cad-96f2-38e7c5d1ab03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:04.587025 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-56264547-c0c3-4cad-96f2-38e7c5d1ab03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:04.587476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-56264547-c0c3-4cad-96f2-38e7c5d1ab03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:04.709098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-353d60e3-4408-4884-8fa1-4d687457493f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:04.719057 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-353d60e3-4408-4884-8fa1-4d687457493f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1513 microversion: 2.1 time: 0.279434 Aug 29 21:55:04.719638 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 311/628] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:04 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:04.731715 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f9104df0-0cbc-4b02-b6f3-6a0f2c4948b5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:04.733650 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f9104df0-0cbc-4b02-b6f3-6a0f2c4948b5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:04.745432 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9104df0-0cbc-4b02-b6f3-6a0f2c4948b5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:04.746642 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9104df0-0cbc-4b02-b6f3-6a0f2c4948b5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:04.747846 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9104df0-0cbc-4b02-b6f3-6a0f2c4948b5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:04.749249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9104df0-0cbc-4b02-b6f3-6a0f2c4948b5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:04.750081 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9104df0-0cbc-4b02-b6f3-6a0f2c4948b5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:04.750864 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9104df0-0cbc-4b02-b6f3-6a0f2c4948b5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:04.809896 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-56264547-c0c3-4cad-96f2-38e7c5d1ab03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:04.833410 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-56264547-c0c3-4cad-96f2-38e7c5d1ab03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.261775 Aug 29 21:55:04.835016 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 318/629] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:04 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:04.980740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f9104df0-0cbc-4b02-b6f3-6a0f2c4948b5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:04.980740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f9104df0-0cbc-4b02-b6f3-6a0f2c4948b5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:04.981104 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f9104df0-0cbc-4b02-b6f3-6a0f2c4948b5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:04.981104 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f9104df0-0cbc-4b02-b6f3-6a0f2c4948b5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1277 microversion: 2.20 time: 0.193934 Aug 29 21:55:04.981104 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 312/630] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:04 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:05.542001 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5332563f-9c7d-4561-915d-4e81a09cce61 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:05.542713 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5332563f-9c7d-4561-915d-4e81a09cce61 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:05.550285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5332563f-9c7d-4561-915d-4e81a09cce61 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:05.551051 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5332563f-9c7d-4561-915d-4e81a09cce61 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:05.552125 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5332563f-9c7d-4561-915d-4e81a09cce61 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:05.553061 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5332563f-9c7d-4561-915d-4e81a09cce61 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:05.553604 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5332563f-9c7d-4561-915d-4e81a09cce61 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:05.557255 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5332563f-9c7d-4561-915d-4e81a09cce61 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:05.655050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-78b79425-6cd6-4ee4-a1be-95ebe6f180d0 req-c51a645c-ccfe-41a1-b8f1-674a595ff3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cc4db2-465f-41c0-8689-d78cccae7601", "name": "network-vif-unplugged", "status": "completed", "tag": "863a5e0b-36a2-41bd-97bc-0a4f754bad9b"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:05.671920 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-78b79425-6cd6-4ee4-a1be-95ebe6f180d0 req-c51a645c-ccfe-41a1-b8f1-674a595ff3fc service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:05.672756 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-78b79425-6cd6-4ee4-a1be-95ebe6f180d0 req-c51a645c-ccfe-41a1-b8f1-674a595ff3fc service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:05.673263 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-78b79425-6cd6-4ee4-a1be-95ebe6f180d0 req-c51a645c-ccfe-41a1-b8f1-674a595ff3fc service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:05.688045 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-78b79425-6cd6-4ee4-a1be-95ebe6f180d0 req-c51a645c-ccfe-41a1-b8f1-674a595ff3fc service nova] Creating event network-vif-unplugged:863a5e0b-36a2-41bd-97bc-0a4f754bad9b for instance 93cc4db2-465f-41c0-8689-d78cccae7601 on hv-cinder-85426 Aug 29 21:55:05.697416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-78b79425-6cd6-4ee4-a1be-95ebe6f180d0 req-c51a645c-ccfe-41a1-b8f1-674a595ff3fc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046846 Aug 29 21:55:05.698790 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 313/631] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:05.738109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5332563f-9c7d-4561-915d-4e81a09cce61 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:05.745576 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ba4b4ff0-5667-42b5-b949-2519fb6639ac tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:05.749618 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5332563f-9c7d-4561-915d-4e81a09cce61 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1672 microversion: 2.1 time: 0.212079 Aug 29 21:55:05.760663 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 319/632] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:05 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1672 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:05.760836 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ba4b4ff0-5667-42b5-b949-2519fb6639ac tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:05.768924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ba4b4ff0-5667-42b5-b949-2519fb6639ac tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:05.769725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ba4b4ff0-5667-42b5-b949-2519fb6639ac tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:05.770288 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ba4b4ff0-5667-42b5-b949-2519fb6639ac tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:05.774257 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ba4b4ff0-5667-42b5-b949-2519fb6639ac tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:05.774257 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ba4b4ff0-5667-42b5-b949-2519fb6639ac tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:05.774257 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ba4b4ff0-5667-42b5-b949-2519fb6639ac tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:05.870029 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f1d36190-29bf-4b54-97ae-4e94d8bfea10 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:05.881102 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f1d36190-29bf-4b54-97ae-4e94d8bfea10 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:05.901043 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f1d36190-29bf-4b54-97ae-4e94d8bfea10 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:05.905256 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f1d36190-29bf-4b54-97ae-4e94d8bfea10 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:05.906299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f1d36190-29bf-4b54-97ae-4e94d8bfea10 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:05.907349 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f1d36190-29bf-4b54-97ae-4e94d8bfea10 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:05.908355 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f1d36190-29bf-4b54-97ae-4e94d8bfea10 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:05.908550 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f1d36190-29bf-4b54-97ae-4e94d8bfea10 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:06.031473 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=4 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:06.052682 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ba4b4ff0-5667-42b5-b949-2519fb6639ac tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:06.089108 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ba4b4ff0-5667-42b5-b949-2519fb6639ac tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1513 microversion: 2.1 time: 0.328096 Aug 29 21:55:06.089108 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 314/633] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:05 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1513 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:06.105618 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7042fda8-e19d-43db-a40a-c09b7c1a74a2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:06.106577 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7042fda8-e19d-43db-a40a-c09b7c1a74a2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:06.133527 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7042fda8-e19d-43db-a40a-c09b7c1a74a2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:06.140418 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7042fda8-e19d-43db-a40a-c09b7c1a74a2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:06.141267 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7042fda8-e19d-43db-a40a-c09b7c1a74a2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:06.143768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7042fda8-e19d-43db-a40a-c09b7c1a74a2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:06.147794 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7042fda8-e19d-43db-a40a-c09b7c1a74a2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:06.153078 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7042fda8-e19d-43db-a40a-c09b7c1a74a2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:06.294098 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f1d36190-29bf-4b54-97ae-4e94d8bfea10 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:06.304756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f1d36190-29bf-4b54-97ae-4e94d8bfea10 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.440230 Aug 29 21:55:06.305518 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 320/634] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:05 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:06.324875 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7042fda8-e19d-43db-a40a-c09b7c1a74a2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:06.337757 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7042fda8-e19d-43db-a40a-c09b7c1a74a2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:06.339867 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7042fda8-e19d-43db-a40a-c09b7c1a74a2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:06.341475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7042fda8-e19d-43db-a40a-c09b7c1a74a2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1277 microversion: 2.20 time: 0.269377 Aug 29 21:55:06.342288 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 315/635] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:06 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1277 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:06.773154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a647fc69-df4f-4578-87ac-727922f764a4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:06.773775 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a647fc69-df4f-4578-87ac-727922f764a4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:06.775732 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=16 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:06.780842 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a647fc69-df4f-4578-87ac-727922f764a4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:06.781160 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a647fc69-df4f-4578-87ac-727922f764a4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:06.782089 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a647fc69-df4f-4578-87ac-727922f764a4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:06.782294 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a647fc69-df4f-4578-87ac-727922f764a4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:06.782755 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a647fc69-df4f-4578-87ac-727922f764a4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:06.783171 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a647fc69-df4f-4578-87ac-727922f764a4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:06.938352 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a647fc69-df4f-4578-87ac-727922f764a4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:06.952737 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a647fc69-df4f-4578-87ac-727922f764a4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1672 microversion: 2.1 time: 0.183275 Aug 29 21:55:06.969905 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 321/636] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:06 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1672 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:07.100008 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ac6c87fd-7ac4-4ecd-bb86-b040cf8e650b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:07.100828 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ac6c87fd-7ac4-4ecd-bb86-b040cf8e650b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:07.107039 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ac6c87fd-7ac4-4ecd-bb86-b040cf8e650b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:07.107656 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ac6c87fd-7ac4-4ecd-bb86-b040cf8e650b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:07.107988 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ac6c87fd-7ac4-4ecd-bb86-b040cf8e650b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:07.108729 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ac6c87fd-7ac4-4ecd-bb86-b040cf8e650b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:07.109377 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ac6c87fd-7ac4-4ecd-bb86-b040cf8e650b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:07.110607 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ac6c87fd-7ac4-4ecd-bb86-b040cf8e650b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:07.278089 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ac6c87fd-7ac4-4ecd-bb86-b040cf8e650b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:07.290682 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ac6c87fd-7ac4-4ecd-bb86-b040cf8e650b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1513 microversion: 2.1 time: 0.195008 Aug 29 21:55:07.300554 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 316/637] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:07 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:07.326834 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2cae59fe-f75d-4ca9-9fe5-5511d4309252 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:07.327774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2cae59fe-f75d-4ca9-9fe5-5511d4309252 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:07.336641 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2cae59fe-f75d-4ca9-9fe5-5511d4309252 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:07.337484 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2cae59fe-f75d-4ca9-9fe5-5511d4309252 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:07.338445 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2cae59fe-f75d-4ca9-9fe5-5511d4309252 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:07.339812 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2cae59fe-f75d-4ca9-9fe5-5511d4309252 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:07.340731 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2cae59fe-f75d-4ca9-9fe5-5511d4309252 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:07.341685 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2cae59fe-f75d-4ca9-9fe5-5511d4309252 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:07.365851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-5225faa7-dbfc-4f1f-b020-c2009dd8a3ab tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:07.369698 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-5225faa7-dbfc-4f1f-b020-c2009dd8a3ab tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:07.376801 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5225faa7-dbfc-4f1f-b020-c2009dd8a3ab tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:07.383510 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5225faa7-dbfc-4f1f-b020-c2009dd8a3ab tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:07.383510 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5225faa7-dbfc-4f1f-b020-c2009dd8a3ab tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:07.383510 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5225faa7-dbfc-4f1f-b020-c2009dd8a3ab tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:07.383510 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5225faa7-dbfc-4f1f-b020-c2009dd8a3ab tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:07.384025 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5225faa7-dbfc-4f1f-b020-c2009dd8a3ab tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:07.459915 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-5225faa7-dbfc-4f1f-b020-c2009dd8a3ab tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:07.469170 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=100 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:07.473412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-5225faa7-dbfc-4f1f-b020-c2009dd8a3ab tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:07.474998 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-5225faa7-dbfc-4f1f-b020-c2009dd8a3ab tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:07.476765 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-5225faa7-dbfc-4f1f-b020-c2009dd8a3ab tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1277 microversion: 2.20 time: 0.114821 Aug 29 21:55:07.477481 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 317/638] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:07 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:07.537310 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2cae59fe-f75d-4ca9-9fe5-5511d4309252 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:07.547282 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2cae59fe-f75d-4ca9-9fe5-5511d4309252 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.224760 Aug 29 21:55:07.547991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 322/639] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:07 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:07.987608 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2b716e5b-fe4b-4bf8-bb3b-72de3f6df487 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:07.988297 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2b716e5b-fe4b-4bf8-bb3b-72de3f6df487 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:07.995846 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b716e5b-fe4b-4bf8-bb3b-72de3f6df487 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:07.996361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b716e5b-fe4b-4bf8-bb3b-72de3f6df487 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:07.996854 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b716e5b-fe4b-4bf8-bb3b-72de3f6df487 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:07.997655 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b716e5b-fe4b-4bf8-bb3b-72de3f6df487 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:07.998150 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b716e5b-fe4b-4bf8-bb3b-72de3f6df487 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:07.998594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b716e5b-fe4b-4bf8-bb3b-72de3f6df487 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:08.182747 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2b716e5b-fe4b-4bf8-bb3b-72de3f6df487 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:08.192103 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2b716e5b-fe4b-4bf8-bb3b-72de3f6df487 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1672 microversion: 2.1 time: 0.208957 Aug 29 21:55:08.193130 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 318/640] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:07 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1672 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:08.314405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-29cbd351-ee18-46dc-95a8-52d9924db9bf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:08.315663 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-29cbd351-ee18-46dc-95a8-52d9924db9bf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:08.321970 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-29cbd351-ee18-46dc-95a8-52d9924db9bf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:08.322717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-29cbd351-ee18-46dc-95a8-52d9924db9bf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:08.323328 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-29cbd351-ee18-46dc-95a8-52d9924db9bf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:08.324332 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-29cbd351-ee18-46dc-95a8-52d9924db9bf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:08.324810 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-29cbd351-ee18-46dc-95a8-52d9924db9bf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:08.327779 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-29cbd351-ee18-46dc-95a8-52d9924db9bf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:08.355005 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:08.488108 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-29cbd351-ee18-46dc-95a8-52d9924db9bf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:08.501843 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-74beffa6-1ff8-452a-b179-0c77ee1a15fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:08.502571 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-74beffa6-1ff8-452a-b179-0c77ee1a15fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:08.508270 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-29cbd351-ee18-46dc-95a8-52d9924db9bf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1513 microversion: 2.1 time: 0.197622 Aug 29 21:55:08.515004 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-74beffa6-1ff8-452a-b179-0c77ee1a15fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:08.516749 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-74beffa6-1ff8-452a-b179-0c77ee1a15fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:08.517018 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 323/641] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:08 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:08.517764 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-74beffa6-1ff8-452a-b179-0c77ee1a15fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:08.518745 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-74beffa6-1ff8-452a-b179-0c77ee1a15fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:08.519360 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-74beffa6-1ff8-452a-b179-0c77ee1a15fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:08.519937 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-74beffa6-1ff8-452a-b179-0c77ee1a15fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:08.569027 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a31289b2-5fc3-4999-83ea-3cc2f85141dd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:08.569738 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a31289b2-5fc3-4999-83ea-3cc2f85141dd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:08.590981 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a31289b2-5fc3-4999-83ea-3cc2f85141dd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:08.596556 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a31289b2-5fc3-4999-83ea-3cc2f85141dd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:08.596556 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a31289b2-5fc3-4999-83ea-3cc2f85141dd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:08.596556 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a31289b2-5fc3-4999-83ea-3cc2f85141dd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:08.596556 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a31289b2-5fc3-4999-83ea-3cc2f85141dd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:08.597093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a31289b2-5fc3-4999-83ea-3cc2f85141dd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:08.615866 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-74beffa6-1ff8-452a-b179-0c77ee1a15fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:08.635866 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-74beffa6-1ff8-452a-b179-0c77ee1a15fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:08.635866 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-74beffa6-1ff8-452a-b179-0c77ee1a15fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:08.635866 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-74beffa6-1ff8-452a-b179-0c77ee1a15fd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1277 microversion: 2.20 time: 0.134436 Aug 29 21:55:08.645882 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 319/642] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:08 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:08.784368 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a31289b2-5fc3-4999-83ea-3cc2f85141dd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:08.800113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a31289b2-5fc3-4999-83ea-3cc2f85141dd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.233980 Aug 29 21:55:08.801903 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 324/643] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:08 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:09.217814 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-79cdb6f0-8cce-41e4-a532-fff387aa60ef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:09.218567 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-79cdb6f0-8cce-41e4-a532-fff387aa60ef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:09.225548 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79cdb6f0-8cce-41e4-a532-fff387aa60ef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:09.226921 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79cdb6f0-8cce-41e4-a532-fff387aa60ef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:09.227613 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79cdb6f0-8cce-41e4-a532-fff387aa60ef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:09.228362 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79cdb6f0-8cce-41e4-a532-fff387aa60ef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:09.229008 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79cdb6f0-8cce-41e4-a532-fff387aa60ef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:09.229645 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-79cdb6f0-8cce-41e4-a532-fff387aa60ef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:09.420336 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-79cdb6f0-8cce-41e4-a532-fff387aa60ef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:09.430898 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-79cdb6f0-8cce-41e4-a532-fff387aa60ef tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1672 microversion: 2.1 time: 0.216915 Aug 29 21:55:09.431872 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 320/644] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:09 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1672 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:09.536670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-61aa3b6a-6315-4766-b796-b84d421a4c7a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:09.537995 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-61aa3b6a-6315-4766-b796-b84d421a4c7a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:09.551282 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-61aa3b6a-6315-4766-b796-b84d421a4c7a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:09.552174 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-61aa3b6a-6315-4766-b796-b84d421a4c7a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:09.552991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-61aa3b6a-6315-4766-b796-b84d421a4c7a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:09.555195 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-61aa3b6a-6315-4766-b796-b84d421a4c7a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:09.556055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-61aa3b6a-6315-4766-b796-b84d421a4c7a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:09.556875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-61aa3b6a-6315-4766-b796-b84d421a4c7a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:09.656915 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0c48920e-d63e-4d82-b7e7-2d10be260025 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:09.657618 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0c48920e-d63e-4d82-b7e7-2d10be260025 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:09.672636 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:09.675741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0c48920e-d63e-4d82-b7e7-2d10be260025 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:09.681852 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0c48920e-d63e-4d82-b7e7-2d10be260025 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:09.694269 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0c48920e-d63e-4d82-b7e7-2d10be260025 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:09.694269 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0c48920e-d63e-4d82-b7e7-2d10be260025 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:09.694269 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0c48920e-d63e-4d82-b7e7-2d10be260025 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:09.694269 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0c48920e-d63e-4d82-b7e7-2d10be260025 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:09.782421 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0c48920e-d63e-4d82-b7e7-2d10be260025 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:09.824518 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0c48920e-d63e-4d82-b7e7-2d10be260025 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:09.824518 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0c48920e-d63e-4d82-b7e7-2d10be260025 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:09.824901 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0c48920e-d63e-4d82-b7e7-2d10be260025 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1277 microversion: 2.20 time: 0.172581 Aug 29 21:55:09.836912 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 321/645] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:09 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:55:09.836912 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-5feb7b8e-d9d5-459f-b988-cd21bfa4034d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:09.836912 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-5feb7b8e-d9d5-459f-b988-cd21bfa4034d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:09.840520 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5feb7b8e-d9d5-459f-b988-cd21bfa4034d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:09.840520 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5feb7b8e-d9d5-459f-b988-cd21bfa4034d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:09.840890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5feb7b8e-d9d5-459f-b988-cd21bfa4034d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:09.845100 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5feb7b8e-d9d5-459f-b988-cd21bfa4034d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:09.845100 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5feb7b8e-d9d5-459f-b988-cd21bfa4034d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:09.845100 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5feb7b8e-d9d5-459f-b988-cd21bfa4034d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:09.879733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-61aa3b6a-6315-4766-b796-b84d421a4c7a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:09.891858 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-61aa3b6a-6315-4766-b796-b84d421a4c7a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1513 microversion: 2.1 time: 0.362754 Aug 29 21:55:09.893098 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 325/646] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:09 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1513 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:10.053990 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-5feb7b8e-d9d5-459f-b988-cd21bfa4034d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:10.063415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-5feb7b8e-d9d5-459f-b988-cd21bfa4034d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.235956 Aug 29 21:55:10.064306 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 322/647] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:09 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:10.455616 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9aa60da1-e138-420f-a442-b4dc710c8254 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:10.456745 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9aa60da1-e138-420f-a442-b4dc710c8254 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:10.464625 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9aa60da1-e138-420f-a442-b4dc710c8254 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:10.465494 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9aa60da1-e138-420f-a442-b4dc710c8254 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:10.466158 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9aa60da1-e138-420f-a442-b4dc710c8254 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:10.467108 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9aa60da1-e138-420f-a442-b4dc710c8254 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:10.467778 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9aa60da1-e138-420f-a442-b4dc710c8254 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:10.468415 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9aa60da1-e138-420f-a442-b4dc710c8254 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:10.636413 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9aa60da1-e138-420f-a442-b4dc710c8254 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:10.645970 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9aa60da1-e138-420f-a442-b4dc710c8254 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1672 microversion: 2.1 time: 0.194307 Aug 29 21:55:10.646988 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 326/648] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:10 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1672 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:10.853663 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-cfb3dead-56de-493d-90cb-3af7660795a5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:10.858416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-cfb3dead-56de-493d-90cb-3af7660795a5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:10.862361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cfb3dead-56de-493d-90cb-3af7660795a5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:10.862958 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cfb3dead-56de-493d-90cb-3af7660795a5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:10.863403 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cfb3dead-56de-493d-90cb-3af7660795a5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:10.864116 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cfb3dead-56de-493d-90cb-3af7660795a5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:10.864598 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cfb3dead-56de-493d-90cb-3af7660795a5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:10.865029 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cfb3dead-56de-493d-90cb-3af7660795a5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:10.930377 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b01349f5-182d-4535-8830-8a85a3e3a392 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:10.931865 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b01349f5-182d-4535-8830-8a85a3e3a392 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:10.941885 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b01349f5-182d-4535-8830-8a85a3e3a392 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:10.942375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b01349f5-182d-4535-8830-8a85a3e3a392 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:10.942810 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b01349f5-182d-4535-8830-8a85a3e3a392 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:10.943514 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b01349f5-182d-4535-8830-8a85a3e3a392 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:10.944053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b01349f5-182d-4535-8830-8a85a3e3a392 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:10.944516 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b01349f5-182d-4535-8830-8a85a3e3a392 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:10.951875 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-cfb3dead-56de-493d-90cb-3af7660795a5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:10.961826 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-cfb3dead-56de-493d-90cb-3af7660795a5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:10.965130 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-cfb3dead-56de-493d-90cb-3af7660795a5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:10.966674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-cfb3dead-56de-493d-90cb-3af7660795a5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1277 microversion: 2.20 time: 0.117728 Aug 29 21:55:10.967705 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 323/649] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:10 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1277 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:11.097743 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-47d9f3d2-7ec8-4595-b264-5089040ac8c8 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:11.098402 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-47d9f3d2-7ec8-4595-b264-5089040ac8c8 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:11.106323 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-47d9f3d2-7ec8-4595-b264-5089040ac8c8 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:11.106729 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-47d9f3d2-7ec8-4595-b264-5089040ac8c8 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:11.107167 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-47d9f3d2-7ec8-4595-b264-5089040ac8c8 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:11.107877 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-47d9f3d2-7ec8-4595-b264-5089040ac8c8 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:11.108331 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-47d9f3d2-7ec8-4595-b264-5089040ac8c8 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:11.108791 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-47d9f3d2-7ec8-4595-b264-5089040ac8c8 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:11.172870 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b01349f5-182d-4535-8830-8a85a3e3a392 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:11.181581 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b01349f5-182d-4535-8830-8a85a3e3a392 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1513 microversion: 2.1 time: 0.256637 Aug 29 21:55:11.190032 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 327/650] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:10 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1513 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:11.301501 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-47d9f3d2-7ec8-4595-b264-5089040ac8c8 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:11.311520 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-47d9f3d2-7ec8-4595-b264-5089040ac8c8 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.218496 Aug 29 21:55:11.324514 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 324/651] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:11 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:11.672847 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-aa7ff740-7faf-4462-80e6-58ea35eec528 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:11.673819 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-aa7ff740-7faf-4462-80e6-58ea35eec528 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:11.679811 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aa7ff740-7faf-4462-80e6-58ea35eec528 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:11.680290 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aa7ff740-7faf-4462-80e6-58ea35eec528 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:11.680755 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aa7ff740-7faf-4462-80e6-58ea35eec528 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:11.681453 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aa7ff740-7faf-4462-80e6-58ea35eec528 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:11.681908 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aa7ff740-7faf-4462-80e6-58ea35eec528 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:11.682330 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-aa7ff740-7faf-4462-80e6-58ea35eec528 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:11.852258 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-aa7ff740-7faf-4462-80e6-58ea35eec528 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:11.862899 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-aa7ff740-7faf-4462-80e6-58ea35eec528 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1672 microversion: 2.1 time: 0.194065 Aug 29 21:55:11.877491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 328/652] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:11 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1672 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:11.997524 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-afd6b98a-6f03-4804-9d0d-5b9d390b383d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:11.998520 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-afd6b98a-6f03-4804-9d0d-5b9d390b383d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:12.009031 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-afd6b98a-6f03-4804-9d0d-5b9d390b383d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:12.009449 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-afd6b98a-6f03-4804-9d0d-5b9d390b383d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:12.009911 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-afd6b98a-6f03-4804-9d0d-5b9d390b383d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:12.010701 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-afd6b98a-6f03-4804-9d0d-5b9d390b383d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:12.011328 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-afd6b98a-6f03-4804-9d0d-5b9d390b383d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:12.011754 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-afd6b98a-6f03-4804-9d0d-5b9d390b383d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:12.096241 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-12f9ca1d-ec43-46f9-b7bc-c628a81c2baa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43ccf79f-6fb7-4b0d-bf5c-3544769e9eaf"}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:12.099745 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-12f9ca1d-ec43-46f9-b7bc-c628a81c2baa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:12.107520 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-afd6b98a-6f03-4804-9d0d-5b9d390b383d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:12.141001 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-afd6b98a-6f03-4804-9d0d-5b9d390b383d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:12.151423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12f9ca1d-ec43-46f9-b7bc-c628a81c2baa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:12.153080 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-afd6b98a-6f03-4804-9d0d-5b9d390b383d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:12.167819 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-afd6b98a-6f03-4804-9d0d-5b9d390b383d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1277 microversion: 2.20 time: 0.178036 Aug 29 21:55:12.173124 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12f9ca1d-ec43-46f9-b7bc-c628a81c2baa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:12.174152 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 325/653] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:11 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:12.174927 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12f9ca1d-ec43-46f9-b7bc-c628a81c2baa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:12.177475 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12f9ca1d-ec43-46f9-b7bc-c628a81c2baa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:12.180622 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12f9ca1d-ec43-46f9-b7bc-c628a81c2baa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:12.182443 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12f9ca1d-ec43-46f9-b7bc-c628a81c2baa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:12.206852 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-1c04a934-0121-49ff-8901-b91094d57fe6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:12.207925 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-1c04a934-0121-49ff-8901-b91094d57fe6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:12.223332 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c04a934-0121-49ff-8901-b91094d57fe6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:12.226561 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c04a934-0121-49ff-8901-b91094d57fe6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:12.228775 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c04a934-0121-49ff-8901-b91094d57fe6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:12.229771 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c04a934-0121-49ff-8901-b91094d57fe6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:12.232940 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c04a934-0121-49ff-8901-b91094d57fe6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:12.233589 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1c04a934-0121-49ff-8901-b91094d57fe6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:12.628705 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-1c04a934-0121-49ff-8901-b91094d57fe6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:12.639421 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-1c04a934-0121-49ff-8901-b91094d57fe6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1513 microversion: 2.1 time: 0.437736 Aug 29 21:55:12.640172 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 326/654] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:12 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1513 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:12.645431 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ddc12762-14ca-4baa-87da-91826acb5b30 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:12.646486 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ddc12762-14ca-4baa-87da-91826acb5b30 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:12.653385 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ddc12762-14ca-4baa-87da-91826acb5b30 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:12.654278 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ddc12762-14ca-4baa-87da-91826acb5b30 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:12.654905 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ddc12762-14ca-4baa-87da-91826acb5b30 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:12.655623 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ddc12762-14ca-4baa-87da-91826acb5b30 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:12.656088 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ddc12762-14ca-4baa-87da-91826acb5b30 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:12.656540 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ddc12762-14ca-4baa-87da-91826acb5b30 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:13.358123 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ddc12762-14ca-4baa-87da-91826acb5b30 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:13.385437 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ddc12762-14ca-4baa-87da-91826acb5b30 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.743606 Aug 29 21:55:13.394646 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 327/655] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:12 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:13.408239 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-cf29a930-75d9-455c-9b24-597507df6f39 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:13.412395 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-cf29a930-75d9-455c-9b24-597507df6f39 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:13.438845 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cf29a930-75d9-455c-9b24-597507df6f39 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:13.440905 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cf29a930-75d9-455c-9b24-597507df6f39 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:13.445286 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cf29a930-75d9-455c-9b24-597507df6f39 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:13.450277 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cf29a930-75d9-455c-9b24-597507df6f39 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:13.451004 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cf29a930-75d9-455c-9b24-597507df6f39 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:13.451705 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cf29a930-75d9-455c-9b24-597507df6f39 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:13.594166 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-cf29a930-75d9-455c-9b24-597507df6f39 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:13.599264 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-cf29a930-75d9-455c-9b24-597507df6f39 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1604 microversion: 2.1 time: 0.203337 Aug 29 21:55:13.600148 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 328/656] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:13 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:13.605634 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d0a7dcdb-fc8c-4ede-b16b-0a812b5afeb6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:13.606648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d0a7dcdb-fc8c-4ede-b16b-0a812b5afeb6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:13.626145 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0a7dcdb-fc8c-4ede-b16b-0a812b5afeb6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:13.627013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0a7dcdb-fc8c-4ede-b16b-0a812b5afeb6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:13.628997 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0a7dcdb-fc8c-4ede-b16b-0a812b5afeb6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:13.630026 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0a7dcdb-fc8c-4ede-b16b-0a812b5afeb6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:13.630654 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0a7dcdb-fc8c-4ede-b16b-0a812b5afeb6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:13.631266 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d0a7dcdb-fc8c-4ede-b16b-0a812b5afeb6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:13.720836 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d0a7dcdb-fc8c-4ede-b16b-0a812b5afeb6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:13.734002 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d0a7dcdb-fc8c-4ede-b16b-0a812b5afeb6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:13.735969 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d0a7dcdb-fc8c-4ede-b16b-0a812b5afeb6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:13.737242 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d0a7dcdb-fc8c-4ede-b16b-0a812b5afeb6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1333 microversion: 2.20 time: 0.135336 Aug 29 21:55:13.738160 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 329/657] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:13 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1333 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:13.743553 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-651a7a11-a380-48a0-bba9-512e39fbbcad tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:13.744168 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-651a7a11-a380-48a0-bba9-512e39fbbcad tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:13.752552 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-651a7a11-a380-48a0-bba9-512e39fbbcad tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:13.753188 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-651a7a11-a380-48a0-bba9-512e39fbbcad tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:13.754350 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-651a7a11-a380-48a0-bba9-512e39fbbcad tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:13.755179 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-651a7a11-a380-48a0-bba9-512e39fbbcad tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:13.755772 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-651a7a11-a380-48a0-bba9-512e39fbbcad tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:13.756316 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-651a7a11-a380-48a0-bba9-512e39fbbcad tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:13.857095 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-12f9ca1d-ec43-46f9-b7bc-c628a81c2baa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "POST /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.765808 Aug 29 21:55:13.858793 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 329/658] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 21:55:12 2022] POST /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-volume_attachments => generated 194 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:14.123696 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-469ef9ea-a21e-4d62-843c-afde4b55dc1a req-820d86da-0365-4cda-bdd5-580729e29696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93cc4db2-465f-41c0-8689-d78cccae7601", "name": "network-vif-deleted", "tag": "863a5e0b-36a2-41bd-97bc-0a4f754bad9b"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:14.152798 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-469ef9ea-a21e-4d62-843c-afde4b55dc1a req-820d86da-0365-4cda-bdd5-580729e29696 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:14.153347 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-469ef9ea-a21e-4d62-843c-afde4b55dc1a req-820d86da-0365-4cda-bdd5-580729e29696 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:14.156766 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-469ef9ea-a21e-4d62-843c-afde4b55dc1a req-820d86da-0365-4cda-bdd5-580729e29696 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:14.177751 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-469ef9ea-a21e-4d62-843c-afde4b55dc1a req-820d86da-0365-4cda-bdd5-580729e29696 service nova] Creating event network-vif-deleted:863a5e0b-36a2-41bd-97bc-0a4f754bad9b for instance 93cc4db2-465f-41c0-8689-d78cccae7601 on hv-cinder-85426 Aug 29 21:55:14.188455 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-469ef9ea-a21e-4d62-843c-afde4b55dc1a req-820d86da-0365-4cda-bdd5-580729e29696 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070179 Aug 29 21:55:14.192655 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 330/659] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 29 21:55:14.434178 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0aadacc6-0b01-4d3d-9cda-0e5774281260 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:14.436234 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-0aadacc6-0b01-4d3d-9cda-0e5774281260 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:14.461497 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0aadacc6-0b01-4d3d-9cda-0e5774281260 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:14.462541 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0aadacc6-0b01-4d3d-9cda-0e5774281260 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:14.463790 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0aadacc6-0b01-4d3d-9cda-0e5774281260 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:14.465120 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-651a7a11-a380-48a0-bba9-512e39fbbcad tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:14.466669 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0aadacc6-0b01-4d3d-9cda-0e5774281260 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:14.469465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0aadacc6-0b01-4d3d-9cda-0e5774281260 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:14.471082 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0aadacc6-0b01-4d3d-9cda-0e5774281260 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:14.480064 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-651a7a11-a380-48a0-bba9-512e39fbbcad tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1513 microversion: 2.1 time: 0.740662 Aug 29 21:55:14.482331 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 330/660] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:13 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1513 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:14.536189 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-a14ce9c4-ba35-498d-abbe-5e92e8522c3f req-1b090ee4-0ab1-4a31-bf35-ca8fbb135555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f59fdcb-151b-40d2-befd-7114b5ac5c89", "name": "network-vif-deleted", "tag": "932e39ce-a89d-40b4-8bde-ff728cdabf30"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:14.574093 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-a14ce9c4-ba35-498d-abbe-5e92e8522c3f req-1b090ee4-0ab1-4a31-bf35-ca8fbb135555 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:14.576121 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-a14ce9c4-ba35-498d-abbe-5e92e8522c3f req-1b090ee4-0ab1-4a31-bf35-ca8fbb135555 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:14.580050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-a14ce9c4-ba35-498d-abbe-5e92e8522c3f req-1b090ee4-0ab1-4a31-bf35-ca8fbb135555 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:14.599716 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-a14ce9c4-ba35-498d-abbe-5e92e8522c3f req-1b090ee4-0ab1-4a31-bf35-ca8fbb135555 service nova] Creating event network-vif-deleted:932e39ce-a89d-40b4-8bde-ff728cdabf30 for instance 3f59fdcb-151b-40d2-befd-7114b5ac5c89 on hv-cinder-85426 Aug 29 21:55:14.608332 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-a14ce9c4-ba35-498d-abbe-5e92e8522c3f req-1b090ee4-0ab1-4a31-bf35-ca8fbb135555 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094660 Aug 29 21:55:14.616141 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 331/661] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:14.803654 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-042dfca5-54bf-4a2e-9932-8b524bcac84b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:14.808402 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-042dfca5-54bf-4a2e-9932-8b524bcac84b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:14.877584 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-042dfca5-54bf-4a2e-9932-8b524bcac84b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:14.878102 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-042dfca5-54bf-4a2e-9932-8b524bcac84b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:14.878581 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-042dfca5-54bf-4a2e-9932-8b524bcac84b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:14.879303 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-042dfca5-54bf-4a2e-9932-8b524bcac84b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:14.879775 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-042dfca5-54bf-4a2e-9932-8b524bcac84b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:14.880215 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-042dfca5-54bf-4a2e-9932-8b524bcac84b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:14.914781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-0aadacc6-0b01-4d3d-9cda-0e5774281260 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:14.930742 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-0aadacc6-0b01-4d3d-9cda-0e5774281260 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.508373 Aug 29 21:55:14.989242 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-042dfca5-54bf-4a2e-9932-8b524bcac84b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:14.989538 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 331/662] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:14 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:14.989953 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-042dfca5-54bf-4a2e-9932-8b524bcac84b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:14.990414 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-042dfca5-54bf-4a2e-9932-8b524bcac84b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:14.990911 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-042dfca5-54bf-4a2e-9932-8b524bcac84b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lazy-loading 'fault' on Instance uuid 93cc4db2-465f-41c0-8689-d78cccae7601 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:55:15.030591 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-cbc509f5-7915-4e41-865e-52c7073307c3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:15.034537 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-cbc509f5-7915-4e41-865e-52c7073307c3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:15.066952 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbc509f5-7915-4e41-865e-52c7073307c3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:15.067749 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbc509f5-7915-4e41-865e-52c7073307c3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:15.070433 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbc509f5-7915-4e41-865e-52c7073307c3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:15.073633 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbc509f5-7915-4e41-865e-52c7073307c3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:15.073633 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbc509f5-7915-4e41-865e-52c7073307c3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:15.073633 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbc509f5-7915-4e41-865e-52c7073307c3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:15.121418 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-042dfca5-54bf-4a2e-9932-8b524bcac84b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:15.133989 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-042dfca5-54bf-4a2e-9932-8b524bcac84b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1325 microversion: 2.1 time: 0.446001 Aug 29 21:55:15.138744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 332/663] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:14 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1325 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:15.198432 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-cbc509f5-7915-4e41-865e-52c7073307c3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:15.208871 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-cbc509f5-7915-4e41-865e-52c7073307c3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:15.217589 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-cbc509f5-7915-4e41-865e-52c7073307c3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:15.219278 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-cbc509f5-7915-4e41-865e-52c7073307c3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1351 microversion: 2.20 time: 0.223385 Aug 29 21:55:15.220140 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 332/664] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:14 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1351 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:15.510063 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e88d8400-beb8-4e8f-af13-0b0c7929c0ee tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:15.512291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e88d8400-beb8-4e8f-af13-0b0c7929c0ee tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:15.524840 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e88d8400-beb8-4e8f-af13-0b0c7929c0ee tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:15.526081 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e88d8400-beb8-4e8f-af13-0b0c7929c0ee tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:15.527345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e88d8400-beb8-4e8f-af13-0b0c7929c0ee tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:15.529012 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e88d8400-beb8-4e8f-af13-0b0c7929c0ee tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:15.530088 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e88d8400-beb8-4e8f-af13-0b0c7929c0ee tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:15.531075 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e88d8400-beb8-4e8f-af13-0b0c7929c0ee tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:15.765895 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e88d8400-beb8-4e8f-af13-0b0c7929c0ee tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:15.776788 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e88d8400-beb8-4e8f-af13-0b0c7929c0ee tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1303 microversion: 2.1 time: 0.276121 Aug 29 21:55:15.793133 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 333/665] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:15 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1303 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:15.968767 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d2624f1b-75fc-4811-a9f9-b889b67a6e43 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:15.969472 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d2624f1b-75fc-4811-a9f9-b889b67a6e43 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:15.988151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d2624f1b-75fc-4811-a9f9-b889b67a6e43 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:15.990935 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d2624f1b-75fc-4811-a9f9-b889b67a6e43 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:15.993014 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d2624f1b-75fc-4811-a9f9-b889b67a6e43 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:15.996852 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d2624f1b-75fc-4811-a9f9-b889b67a6e43 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:15.996852 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d2624f1b-75fc-4811-a9f9-b889b67a6e43 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:15.996852 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d2624f1b-75fc-4811-a9f9-b889b67a6e43 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:16.161130 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-966a7fd5-deb2-41d2-9ed6-ea8de462350f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:16.162816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-966a7fd5-deb2-41d2-9ed6-ea8de462350f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:16.175325 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-966a7fd5-deb2-41d2-9ed6-ea8de462350f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:16.175325 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-966a7fd5-deb2-41d2-9ed6-ea8de462350f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:16.175325 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-966a7fd5-deb2-41d2-9ed6-ea8de462350f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:16.175325 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-966a7fd5-deb2-41d2-9ed6-ea8de462350f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:16.175805 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-966a7fd5-deb2-41d2-9ed6-ea8de462350f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:16.176714 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-966a7fd5-deb2-41d2-9ed6-ea8de462350f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:16.256376 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d2624f1b-75fc-4811-a9f9-b889b67a6e43 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:16.259833 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-966a7fd5-deb2-41d2-9ed6-ea8de462350f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:16.260541 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-966a7fd5-deb2-41d2-9ed6-ea8de462350f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:16.261804 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-966a7fd5-deb2-41d2-9ed6-ea8de462350f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:16.262416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-966a7fd5-deb2-41d2-9ed6-ea8de462350f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lazy-loading 'fault' on Instance uuid 93cc4db2-465f-41c0-8689-d78cccae7601 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:55:16.269478 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d2624f1b-75fc-4811-a9f9-b889b67a6e43 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.315889 Aug 29 21:55:16.270991 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=100 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:16.272197 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 333/666] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:15 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:16.280517 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-80096040-1d9d-4939-80f2-5b35a752233a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:16.286765 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-80096040-1d9d-4939-80f2-5b35a752233a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:16.300700 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-80096040-1d9d-4939-80f2-5b35a752233a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:16.305411 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-80096040-1d9d-4939-80f2-5b35a752233a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:16.306016 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-80096040-1d9d-4939-80f2-5b35a752233a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:16.306652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-80096040-1d9d-4939-80f2-5b35a752233a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:16.307117 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-80096040-1d9d-4939-80f2-5b35a752233a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:16.307559 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-80096040-1d9d-4939-80f2-5b35a752233a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:16.356782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-966a7fd5-deb2-41d2-9ed6-ea8de462350f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:16.369922 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-966a7fd5-deb2-41d2-9ed6-ea8de462350f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1325 microversion: 2.1 time: 0.213438 Aug 29 21:55:16.374763 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 334/667] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:16 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1325 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:16.438148 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-80096040-1d9d-4939-80f2-5b35a752233a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:16.447510 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-80096040-1d9d-4939-80f2-5b35a752233a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:16.449406 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-80096040-1d9d-4939-80f2-5b35a752233a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:16.450767 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-80096040-1d9d-4939-80f2-5b35a752233a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1339 microversion: 2.20 time: 0.176501 Aug 29 21:55:16.451894 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 334/668] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:16 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1339 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:16.800210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-182fcd09-fb99-4792-ae74-12fa39ce58c5 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:16.801005 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-182fcd09-fb99-4792-ae74-12fa39ce58c5 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:16.820256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-182fcd09-fb99-4792-ae74-12fa39ce58c5 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:16.821058 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-182fcd09-fb99-4792-ae74-12fa39ce58c5 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:16.821611 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-182fcd09-fb99-4792-ae74-12fa39ce58c5 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:16.822508 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-182fcd09-fb99-4792-ae74-12fa39ce58c5 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:16.823039 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-182fcd09-fb99-4792-ae74-12fa39ce58c5 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:16.823482 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-182fcd09-fb99-4792-ae74-12fa39ce58c5 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:16.874970 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-182fcd09-fb99-4792-ae74-12fa39ce58c5 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:16.875466 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-182fcd09-fb99-4792-ae74-12fa39ce58c5 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:16.875949 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-182fcd09-fb99-4792-ae74-12fa39ce58c5 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:16.876556 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-182fcd09-fb99-4792-ae74-12fa39ce58c5 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lazy-loading 'fault' on Instance uuid 3f59fdcb-151b-40d2-befd-7114b5ac5c89 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:55:16.929011 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-182fcd09-fb99-4792-ae74-12fa39ce58c5 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:16.940409 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-182fcd09-fb99-4792-ae74-12fa39ce58c5 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1308 microversion: 2.1 time: 0.144834 Aug 29 21:55:16.941114 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 335/669] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:16 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1308 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:17.313390 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e5ff083f-dab5-4465-8998-d0c72d2c6fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:17.314201 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-e5ff083f-dab5-4465-8998-d0c72d2c6fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:17.322808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5ff083f-dab5-4465-8998-d0c72d2c6fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:17.323872 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5ff083f-dab5-4465-8998-d0c72d2c6fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:17.324618 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5ff083f-dab5-4465-8998-d0c72d2c6fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:17.325373 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5ff083f-dab5-4465-8998-d0c72d2c6fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:17.325882 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5ff083f-dab5-4465-8998-d0c72d2c6fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:17.326362 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5ff083f-dab5-4465-8998-d0c72d2c6fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:17.420224 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ffe25a13-9dfa-40cc-844b-56361464cc1d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:17.420955 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ffe25a13-9dfa-40cc-844b-56361464cc1d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:17.429113 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ffe25a13-9dfa-40cc-844b-56361464cc1d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:17.429736 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ffe25a13-9dfa-40cc-844b-56361464cc1d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:17.430070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ffe25a13-9dfa-40cc-844b-56361464cc1d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:17.430970 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ffe25a13-9dfa-40cc-844b-56361464cc1d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:17.431591 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ffe25a13-9dfa-40cc-844b-56361464cc1d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:17.432203 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ffe25a13-9dfa-40cc-844b-56361464cc1d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:17.467059 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ffe25a13-9dfa-40cc-844b-56361464cc1d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:17.467592 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ffe25a13-9dfa-40cc-844b-56361464cc1d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:17.468103 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ffe25a13-9dfa-40cc-844b-56361464cc1d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:17.468605 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-ffe25a13-9dfa-40cc-844b-56361464cc1d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lazy-loading 'fault' on Instance uuid 93cc4db2-465f-41c0-8689-d78cccae7601 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:55:17.515959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ffe25a13-9dfa-40cc-844b-56361464cc1d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:17.524434 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ffe25a13-9dfa-40cc-844b-56361464cc1d tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 200 len: 1325 microversion: 2.1 time: 0.114560 Aug 29 21:55:17.525060 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 336/670] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:17 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 1325 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:17.541158 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-144860fa-4eb3-419f-ada9-5f7e7c4c5f6b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:17.541784 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-144860fa-4eb3-419f-ada9-5f7e7c4c5f6b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:17.543723 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e5ff083f-dab5-4465-8998-d0c72d2c6fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:17.548957 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-144860fa-4eb3-419f-ada9-5f7e7c4c5f6b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:17.549463 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-144860fa-4eb3-419f-ada9-5f7e7c4c5f6b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:17.549912 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-144860fa-4eb3-419f-ada9-5f7e7c4c5f6b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:17.550648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-144860fa-4eb3-419f-ada9-5f7e7c4c5f6b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:17.551121 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-144860fa-4eb3-419f-ada9-5f7e7c4c5f6b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:17.551558 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-144860fa-4eb3-419f-ada9-5f7e7c4c5f6b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:17.553255 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e5ff083f-dab5-4465-8998-d0c72d2c6fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.245055 Aug 29 21:55:17.554617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 335/671] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:17 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:17.702951 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-144860fa-4eb3-419f-ada9-5f7e7c4c5f6b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:17.712369 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-144860fa-4eb3-419f-ada9-5f7e7c4c5f6b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:17.713924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-144860fa-4eb3-419f-ada9-5f7e7c4c5f6b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:17.715059 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-144860fa-4eb3-419f-ada9-5f7e7c4c5f6b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1407 microversion: 2.20 time: 0.189063 Aug 29 21:55:17.715616 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 337/672] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:17 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:17.964161 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f87e35b9-8b17-4362-b2e2-c0ef2e2d48e6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:17.964840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f87e35b9-8b17-4362-b2e2-c0ef2e2d48e6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:17.972132 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f87e35b9-8b17-4362-b2e2-c0ef2e2d48e6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:17.972654 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f87e35b9-8b17-4362-b2e2-c0ef2e2d48e6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:17.973104 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f87e35b9-8b17-4362-b2e2-c0ef2e2d48e6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:17.973787 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f87e35b9-8b17-4362-b2e2-c0ef2e2d48e6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:17.974235 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f87e35b9-8b17-4362-b2e2-c0ef2e2d48e6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:17.974693 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f87e35b9-8b17-4362-b2e2-c0ef2e2d48e6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:18.033322 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f87e35b9-8b17-4362-b2e2-c0ef2e2d48e6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:18.034383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f87e35b9-8b17-4362-b2e2-c0ef2e2d48e6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:18.035101 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f87e35b9-8b17-4362-b2e2-c0ef2e2d48e6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:18.035780 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-f87e35b9-8b17-4362-b2e2-c0ef2e2d48e6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lazy-loading 'fault' on Instance uuid 3f59fdcb-151b-40d2-befd-7114b5ac5c89 {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:55:18.089902 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f87e35b9-8b17-4362-b2e2-c0ef2e2d48e6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:18.105512 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f87e35b9-8b17-4362-b2e2-c0ef2e2d48e6 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 200 len: 1308 microversion: 2.1 time: 0.146088 Aug 29 21:55:18.106824 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 336/673] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:17 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 1308 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:18.548624 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-690ea5af-6edd-4daa-9987-74a2af337a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:18.554399 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-690ea5af-6edd-4daa-9987-74a2af337a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:18.557681 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-625a0e41-9aca-4fe3-9139-bf0c9a0d5074 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:18.558456 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-625a0e41-9aca-4fe3-9139-bf0c9a0d5074 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:18.571853 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-625a0e41-9aca-4fe3-9139-bf0c9a0d5074 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:18.572525 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-625a0e41-9aca-4fe3-9139-bf0c9a0d5074 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:18.573243 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-625a0e41-9aca-4fe3-9139-bf0c9a0d5074 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:18.577210 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-625a0e41-9aca-4fe3-9139-bf0c9a0d5074 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:18.578037 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-625a0e41-9aca-4fe3-9139-bf0c9a0d5074 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:18.578196 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-690ea5af-6edd-4daa-9987-74a2af337a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:18.578901 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-625a0e41-9aca-4fe3-9139-bf0c9a0d5074 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:18.583954 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-690ea5af-6edd-4daa-9987-74a2af337a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:18.585185 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-690ea5af-6edd-4daa-9987-74a2af337a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:18.586439 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-690ea5af-6edd-4daa-9987-74a2af337a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:18.588948 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-690ea5af-6edd-4daa-9987-74a2af337a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:18.589538 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-690ea5af-6edd-4daa-9987-74a2af337a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:18.598467 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-625a0e41-9aca-4fe3-9139-bf0c9a0d5074 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] HTTP exception thrown: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-625a0e41-9aca-4fe3-9139-bf0c9a0d5074 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Request method failure captured: Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 HTTP/1.1 Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTSxxfRUI7l52of29zB3ZslHUdBQFJCfPXD0NWyt1ueGx_jVZKX4tfkmalYN2PfXJ8Fh_NLar_HSQW2MuxynwdF8Njj5tPSbFDgAiOY7LFxpbZ54ghTWDY5nkh7JRhPPIuTEShd0Pq6q6a6B2kB6mswBb8y6iSMXHKEOcdbAM38Llm8 Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: d45ce54651ad4326bccecbeea8b5b084 Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:55:18.601121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:55:18.602883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:55:18.602883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:55:18.602883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: d45ce54651ad4326bccecbeea8b5b084 Aug 29 21:55:18.602883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:55:18.602883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeTestJSON-644969764-project Aug 29 21:55:18.602883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:55:18.602883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:55:18.602883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: ed8ef9f9eafd4248bae86f0e8ec72731 Aug 29 21:55:18.602883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeTestJSON-644969764-project Aug 29 21:55:18.602883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:55:18.602883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. Aug 29 21:55:18.602883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '93cc4db2-465f-41c0-8689-d78cccae7601'} Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:55:18.603840 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. Aug 29 21:55:18.605469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:55:18.608764 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-625a0e41-9aca-4fe3-9139-bf0c9a0d5074 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Returning 404 to user: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:55:18.620107 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-625a0e41-9aca-4fe3-9139-bf0c9a0d5074 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 404 len: 111 microversion: 2.1 time: 0.058057 Aug 29 21:55:18.620107 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 337/674] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:18 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:55:18.623316 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-43e0cd73-fc90-41f6-9886-2afb7e606ab9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:18.624295 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-43e0cd73-fc90-41f6-9886-2afb7e606ab9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:18.633007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-43e0cd73-fc90-41f6-9886-2afb7e606ab9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:18.633821 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-43e0cd73-fc90-41f6-9886-2afb7e606ab9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:18.634474 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-43e0cd73-fc90-41f6-9886-2afb7e606ab9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:18.635465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-43e0cd73-fc90-41f6-9886-2afb7e606ab9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:18.636132 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-43e0cd73-fc90-41f6-9886-2afb7e606ab9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:18.636769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-43e0cd73-fc90-41f6-9886-2afb7e606ab9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:18.637349 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-690ea5af-6edd-4daa-9987-74a2af337a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lazy-loading 'flavor' on Instance uuid 945580b2-8dd8-43c7-a485-9501fd158032 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:55:18.848743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-43e0cd73-fc90-41f6-9886-2afb7e606ab9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:18.868961 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-43e0cd73-fc90-41f6-9886-2afb7e606ab9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.254945 Aug 29 21:55:18.869890 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 338/675] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:18 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:18.878123 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a9662411-ed9a-4d13-a52e-417d58cb9c2f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '.version_select at 0x7f504075d550>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:19.061075 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a9662411-ed9a-4d13-a52e-417d58cb9c2f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-84336297" status: 202 len: 0 microversion: 2.1 time: 0.189034 Aug 29 21:55:19.062435 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 339/676] 10.222.0.83 () {58 vars in 1215 bytes} [Mon Aug 29 21:55:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-84336297 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:55:19.068822 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ee4e75c5-a26f-4dab-9c69-da2ac7fbcae6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:19.069687 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ee4e75c5-a26f-4dab-9c69-da2ac7fbcae6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:19.077010 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ee4e75c5-a26f-4dab-9c69-da2ac7fbcae6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:19.078761 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ee4e75c5-a26f-4dab-9c69-da2ac7fbcae6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:19.079676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ee4e75c5-a26f-4dab-9c69-da2ac7fbcae6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:19.081134 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ee4e75c5-a26f-4dab-9c69-da2ac7fbcae6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:19.082160 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ee4e75c5-a26f-4dab-9c69-da2ac7fbcae6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:19.083107 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ee4e75c5-a26f-4dab-9c69-da2ac7fbcae6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:19.193457 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-690ea5af-6edd-4daa-9987-74a2af337a5c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "POST /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/action" status: 200 len: 32 microversion: 2.1 time: 0.651925 Aug 29 21:55:19.194672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 338/677] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 21:55:18 2022] POST /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/action => generated 32 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:55:19.206682 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-c718a59f-5e7a-4f2b-ac84-5d8cfbbe6121 req-f1d575dc-653b-44f8-a10e-0759e4e01981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d01db998-129a-4b44-a3c4-1da1bf023620", "tag": "95ba8615-923a-46f1-ae70-f15459156d2b"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:19.245722 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-c718a59f-5e7a-4f2b-ac84-5d8cfbbe6121 req-f1d575dc-653b-44f8-a10e-0759e4e01981 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:19.246256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-c718a59f-5e7a-4f2b-ac84-5d8cfbbe6121 req-f1d575dc-653b-44f8-a10e-0759e4e01981 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:19.246739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-c718a59f-5e7a-4f2b-ac84-5d8cfbbe6121 req-f1d575dc-653b-44f8-a10e-0759e4e01981 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:19.264207 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-c718a59f-5e7a-4f2b-ac84-5d8cfbbe6121 req-f1d575dc-653b-44f8-a10e-0759e4e01981 service nova] Creating event network-changed:95ba8615-923a-46f1-ae70-f15459156d2b for instance d01db998-129a-4b44-a3c4-1da1bf023620 on hv-cinder-85426 Aug 29 21:55:19.273130 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-c718a59f-5e7a-4f2b-ac84-5d8cfbbe6121 req-f1d575dc-653b-44f8-a10e-0759e4e01981 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070541 Aug 29 21:55:19.273983 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 339/678] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:19.280207 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-291e1022-fc99-45dc-a9d1-2d90059e3f2a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:19.281073 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-291e1022-fc99-45dc-a9d1-2d90059e3f2a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 3f59fdcb-151b-40d2-befd-7114b5ac5c89] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:19.282108 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ee4e75c5-a26f-4dab-9c69-da2ac7fbcae6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:19.288859 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-291e1022-fc99-45dc-a9d1-2d90059e3f2a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:19.289050 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:19.289943 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-291e1022-fc99-45dc-a9d1-2d90059e3f2a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:19.290458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-291e1022-fc99-45dc-a9d1-2d90059e3f2a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:19.291229 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-291e1022-fc99-45dc-a9d1-2d90059e3f2a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:19.291747 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-291e1022-fc99-45dc-a9d1-2d90059e3f2a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:19.292232 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-291e1022-fc99-45dc-a9d1-2d90059e3f2a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:19.299839 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ee4e75c5-a26f-4dab-9c69-da2ac7fbcae6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:19.302779 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ee4e75c5-a26f-4dab-9c69-da2ac7fbcae6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:19.305139 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ee4e75c5-a26f-4dab-9c69-da2ac7fbcae6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1407 microversion: 2.20 time: 0.240966 Aug 29 21:55:19.306597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 340/679] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:19 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:19.308348 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-291e1022-fc99-45dc-a9d1-2d90059e3f2a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] HTTP exception thrown: Instance 3f59fdcb-151b-40d2-befd-7114b5ac5c89 could not be found. Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-291e1022-fc99-45dc-a9d1-2d90059e3f2a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Request method failure captured: Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 HTTP/1.1 Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTU_QSGUOk_j8qKwHy6GbsAenqtmHYL4JlJgf8jfbi3P6RZ9sKI9nbgVqTCIi2NvHjHhfo58t5-vOmzeTvj2pQb7JQzrTB92rgg6L3bIq8TzXLb2n8-GV43AXRnQcP2831GKUK-f5kSEY_a3_Y5qTTg2QnlKmYalFG4HLMKsGYCeGzQ Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: 1515d87b44484ec4904ec2303c9f1f33 Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1032545165 Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 21:55:19.310132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 21:55:19.314923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1515d87b44484ec4904ec2303c9f1f33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_1515d87b44484ec4904ec2303c9f1f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/1515d87b44484ec4904ec2303c9f1f33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1515d87b44484ec4904ec2303c9f1f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:55:19.314923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-VolumesSnapshotTestJSON-1032545165 Aug 29 21:55:19.314923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: 1515d87b44484ec4904ec2303c9f1f33 Aug 29 21:55:19.314923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1032545165 Aug 29 21:55:19.314923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-VolumesSnapshotTestJSON-1032545165-project Aug 29 21:55:19.314923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 21:55:19.314923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 21:55:19.314923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 9f617d6e3f3444cda7307794d7b8d837 Aug 29 21:55:19.314923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-VolumesSnapshotTestJSON-1032545165-project Aug 29 21:55:19.314923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 21:55:19.314923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance 3f59fdcb-151b-40d2-befd-7114b5ac5c89 could not be found. Aug 29 21:55:19.314923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': '3f59fdcb-151b-40d2-befd-7114b5ac5c89'} Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f59fdcb-151b-40d2-befd-7114b5ac5c89 could not be found. Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:55:19.323359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f59fdcb-151b-40d2-befd-7114b5ac5c89 could not be found. Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f59fdcb-151b-40d2-befd-7114b5ac5c89 could not be found. Aug 29 21:55:19.326249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:55:19.328370 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-291e1022-fc99-45dc-a9d1-2d90059e3f2a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Returning 404 to user: Instance 3f59fdcb-151b-40d2-befd-7114b5ac5c89 could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:55:19.328370 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-291e1022-fc99-45dc-a9d1-2d90059e3f2a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89" status: 404 len: 111 microversion: 2.1 time: 0.036134 Aug 29 21:55:19.328370 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 340/680] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:19 2022] GET /compute/v2.1/servers/3f59fdcb-151b-40d2-befd-7114b5ac5c89 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:55:19.333637 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-156886de-9209-4dee-8dd3-35704b3c1e62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:19.335737 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-156886de-9209-4dee-8dd3-35704b3c1e62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:19.347541 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-156886de-9209-4dee-8dd3-35704b3c1e62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:19.348582 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-156886de-9209-4dee-8dd3-35704b3c1e62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:19.349355 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-156886de-9209-4dee-8dd3-35704b3c1e62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:19.351288 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-156886de-9209-4dee-8dd3-35704b3c1e62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:19.352722 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-156886de-9209-4dee-8dd3-35704b3c1e62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:19.353789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-156886de-9209-4dee-8dd3-35704b3c1e62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:19.574046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-156886de-9209-4dee-8dd3-35704b3c1e62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:19.591444 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-156886de-9209-4dee-8dd3-35704b3c1e62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1736 microversion: 2.1 time: 0.283130 Aug 29 21:55:19.592969 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 341/681] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:19 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1736 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:19.894135 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a2479787-8fc8-4ff5-b7c2-4cb0131c680b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:19.895672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a2479787-8fc8-4ff5-b7c2-4cb0131c680b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:19.906246 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a2479787-8fc8-4ff5-b7c2-4cb0131c680b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:19.906742 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a2479787-8fc8-4ff5-b7c2-4cb0131c680b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:19.907186 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a2479787-8fc8-4ff5-b7c2-4cb0131c680b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:19.907958 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a2479787-8fc8-4ff5-b7c2-4cb0131c680b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:19.908514 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a2479787-8fc8-4ff5-b7c2-4cb0131c680b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:19.908972 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a2479787-8fc8-4ff5-b7c2-4cb0131c680b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:20.297301 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a2479787-8fc8-4ff5-b7c2-4cb0131c680b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:20.313825 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a2479787-8fc8-4ff5-b7c2-4cb0131c680b tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.426773 Aug 29 21:55:20.315105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 341/682] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:19 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:20.344766 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-15cec2f3-e127-4937-9fee-061699c8166b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:20.346156 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-15cec2f3-e127-4937-9fee-061699c8166b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:20.382179 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15cec2f3-e127-4937-9fee-061699c8166b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:20.384711 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15cec2f3-e127-4937-9fee-061699c8166b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:20.385904 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15cec2f3-e127-4937-9fee-061699c8166b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:20.387598 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15cec2f3-e127-4937-9fee-061699c8166b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:20.389170 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15cec2f3-e127-4937-9fee-061699c8166b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:20.393363 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-15cec2f3-e127-4937-9fee-061699c8166b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:20.609968 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-15cec2f3-e127-4937-9fee-061699c8166b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:20.619412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a0663407-e881-42f0-96ef-24193fba23d9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:20.623041 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a0663407-e881-42f0-96ef-24193fba23d9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:20.631137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a0663407-e881-42f0-96ef-24193fba23d9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:20.633246 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a0663407-e881-42f0-96ef-24193fba23d9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:20.633920 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a0663407-e881-42f0-96ef-24193fba23d9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:20.635054 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a0663407-e881-42f0-96ef-24193fba23d9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:20.635746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a0663407-e881-42f0-96ef-24193fba23d9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:20.636393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-15cec2f3-e127-4937-9fee-061699c8166b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:20.636652 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a0663407-e881-42f0-96ef-24193fba23d9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:20.639805 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-15cec2f3-e127-4937-9fee-061699c8166b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:20.648514 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-15cec2f3-e127-4937-9fee-061699c8166b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1407 microversion: 2.20 time: 0.303296 Aug 29 21:55:20.648514 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 342/683] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:20 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:20.920251 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a0663407-e881-42f0-96ef-24193fba23d9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:20.930112 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a0663407-e881-42f0-96ef-24193fba23d9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1736 microversion: 2.1 time: 0.318050 Aug 29 21:55:20.930734 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 342/684] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:20 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1736 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:21.158715 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-3fecb900-69fa-4d5f-8320-7af3fc941cba tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Action: 'create', calling method: .version_select at 0x7f50406ab5e0>, body: {"keypair": {"name": "tempest-keypair-641637025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUDTVwZaZiwy+Ou70d0b5nrvOEGrehTKAPk8NJ5EUWEXkyXAsbJzcInZysIfKd7Avm2na3pTMJLKBMq5JTlmhb/OqmR97RO5meGlkdd7NyBAZjYuJmUjkgZ6N+fz5lU7w=="}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:21.176108 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-3fecb900-69fa-4d5f-8320-7af3fc941cba tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Getting quotas for project d45ce54651ad4326bccecbeea8b5b084. Resources: {'key_pairs'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:55:21.182660 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-3fecb900-69fa-4d5f-8320-7af3fc941cba tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Getting quotas for user ed8ef9f9eafd4248bae86f0e8ec72731 and project d45ce54651ad4326bccecbeea8b5b084. Resources: {'key_pairs'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:55:21.289654 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-3fecb900-69fa-4d5f-8320-7af3fc941cba tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.136191 Aug 29 21:55:21.290568 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 343/685] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 21:55:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:21.339099 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d70256bc-137f-4d2b-a9bb-6ef2b3cd03ab tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:21.347927 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d70256bc-137f-4d2b-a9bb-6ef2b3cd03ab tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:21.359745 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d70256bc-137f-4d2b-a9bb-6ef2b3cd03ab tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:21.360800 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d70256bc-137f-4d2b-a9bb-6ef2b3cd03ab tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:21.361803 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d70256bc-137f-4d2b-a9bb-6ef2b3cd03ab tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:21.362937 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d70256bc-137f-4d2b-a9bb-6ef2b3cd03ab tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:21.363896 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d70256bc-137f-4d2b-a9bb-6ef2b3cd03ab tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:21.364699 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d70256bc-137f-4d2b-a9bb-6ef2b3cd03ab tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:21.671229 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f6add95e-f9ff-4784-9d4a-7c664bb0e026 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:21.674756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f6add95e-f9ff-4784-9d4a-7c664bb0e026 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:21.691082 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6add95e-f9ff-4784-9d4a-7c664bb0e026 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:21.692108 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6add95e-f9ff-4784-9d4a-7c664bb0e026 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:21.693506 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6add95e-f9ff-4784-9d4a-7c664bb0e026 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:21.697324 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6add95e-f9ff-4784-9d4a-7c664bb0e026 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:21.697836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6add95e-f9ff-4784-9d4a-7c664bb0e026 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:21.699420 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f6add95e-f9ff-4784-9d4a-7c664bb0e026 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:21.799188 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d70256bc-137f-4d2b-a9bb-6ef2b3cd03ab tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:21.810777 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d70256bc-137f-4d2b-a9bb-6ef2b3cd03ab tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.476763 Aug 29 21:55:21.817589 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 343/686] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:21 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:21.896210 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f6add95e-f9ff-4784-9d4a-7c664bb0e026 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:21.906716 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f6add95e-f9ff-4784-9d4a-7c664bb0e026 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:21.908251 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f6add95e-f9ff-4784-9d4a-7c664bb0e026 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:21.909725 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f6add95e-f9ff-4784-9d4a-7c664bb0e026 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1407 microversion: 2.20 time: 0.243932 Aug 29 21:55:21.910295 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 344/687] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:21 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:21.964064 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4ff74578-0c6c-4d94-b0b4-497ca0ee685a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:21.964852 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4ff74578-0c6c-4d94-b0b4-497ca0ee685a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:21.971896 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ff74578-0c6c-4d94-b0b4-497ca0ee685a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:21.972726 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ff74578-0c6c-4d94-b0b4-497ca0ee685a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:21.973351 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ff74578-0c6c-4d94-b0b4-497ca0ee685a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:21.974057 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ff74578-0c6c-4d94-b0b4-497ca0ee685a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:21.974665 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ff74578-0c6c-4d94-b0b4-497ca0ee685a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:21.975244 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4ff74578-0c6c-4d94-b0b4-497ca0ee685a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:22.022374 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-27735503-b80f-49a6-8590-9730aaf3c0ec req-a98519d8-1044-4c4f-b038-dc17bd53049d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9b91c1-cfde-4d81-ac00-b83f8b333df9", "name": "network-vif-plugged", "status": "completed", "tag": "b88a29b5-ab90-482e-8b10-2c1389ed5c8b"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:22.034369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-27735503-b80f-49a6-8590-9730aaf3c0ec req-a98519d8-1044-4c4f-b038-dc17bd53049d service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:22.035014 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-27735503-b80f-49a6-8590-9730aaf3c0ec req-a98519d8-1044-4c4f-b038-dc17bd53049d service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:22.035600 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-27735503-b80f-49a6-8590-9730aaf3c0ec req-a98519d8-1044-4c4f-b038-dc17bd53049d service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:22.048771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-27735503-b80f-49a6-8590-9730aaf3c0ec req-a98519d8-1044-4c4f-b038-dc17bd53049d service nova] Creating event network-vif-plugged:b88a29b5-ab90-482e-8b10-2c1389ed5c8b for instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 on hv-cinder-85426 Aug 29 21:55:22.058671 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-27735503-b80f-49a6-8590-9730aaf3c0ec req-a98519d8-1044-4c4f-b038-dc17bd53049d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041049 Aug 29 21:55:22.059315 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 345/688] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:22.252615 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4ff74578-0c6c-4d94-b0b4-497ca0ee685a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:22.262433 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4ff74578-0c6c-4d94-b0b4-497ca0ee685a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1736 microversion: 2.1 time: 0.302868 Aug 29 21:55:22.262989 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 344/689] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:21 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1736 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:22.842570 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-01a1e156-01ef-4edf-84d7-d6e9fa559134 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:22.843645 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-01a1e156-01ef-4edf-84d7-d6e9fa559134 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:22.853897 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01a1e156-01ef-4edf-84d7-d6e9fa559134 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:22.854506 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01a1e156-01ef-4edf-84d7-d6e9fa559134 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:22.855139 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01a1e156-01ef-4edf-84d7-d6e9fa559134 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:22.856146 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01a1e156-01ef-4edf-84d7-d6e9fa559134 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:22.856790 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01a1e156-01ef-4edf-84d7-d6e9fa559134 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:22.857311 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01a1e156-01ef-4edf-84d7-d6e9fa559134 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:22.937995 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-58c06634-efaf-42e0-96dc-b95b652e157c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:22.952213 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-58c06634-efaf-42e0-96dc-b95b652e157c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:22.952213 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58c06634-efaf-42e0-96dc-b95b652e157c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:22.952213 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58c06634-efaf-42e0-96dc-b95b652e157c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:22.952213 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58c06634-efaf-42e0-96dc-b95b652e157c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:22.952798 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58c06634-efaf-42e0-96dc-b95b652e157c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:22.952798 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58c06634-efaf-42e0-96dc-b95b652e157c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:22.952798 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-58c06634-efaf-42e0-96dc-b95b652e157c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:23.038871 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-01a1e156-01ef-4edf-84d7-d6e9fa559134 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:23.047640 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-01a1e156-01ef-4edf-84d7-d6e9fa559134 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.211221 Aug 29 21:55:23.048238 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 346/690] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:22 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:23.128631 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-58c06634-efaf-42e0-96dc-b95b652e157c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:23.138232 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-58c06634-efaf-42e0-96dc-b95b652e157c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:23.139959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-58c06634-efaf-42e0-96dc-b95b652e157c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:23.141329 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-58c06634-efaf-42e0-96dc-b95b652e157c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1407 microversion: 2.20 time: 0.209631 Aug 29 21:55:23.142007 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 345/691] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:22 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:55:23.284885 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-8212067d-48d9-4cef-9a6a-f3a7528551b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:23.285494 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-8212067d-48d9-4cef-9a6a-f3a7528551b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:23.292522 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8212067d-48d9-4cef-9a6a-f3a7528551b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:23.293110 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8212067d-48d9-4cef-9a6a-f3a7528551b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:23.294326 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8212067d-48d9-4cef-9a6a-f3a7528551b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:23.295924 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8212067d-48d9-4cef-9a6a-f3a7528551b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:23.303520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8212067d-48d9-4cef-9a6a-f3a7528551b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:23.304405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8212067d-48d9-4cef-9a6a-f3a7528551b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:23.478674 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-8212067d-48d9-4cef-9a6a-f3a7528551b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:23.487294 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-8212067d-48d9-4cef-9a6a-f3a7528551b1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1736 microversion: 2.1 time: 0.206250 Aug 29 21:55:23.493552 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 347/692] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:23 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:24.078100 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-53dfd0c2-a51c-468d-9cd0-dac9df3a3f92 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:24.078719 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-53dfd0c2-a51c-468d-9cd0-dac9df3a3f92 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:24.085185 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-53dfd0c2-a51c-468d-9cd0-dac9df3a3f92 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:24.085739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-53dfd0c2-a51c-468d-9cd0-dac9df3a3f92 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:24.088113 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-53dfd0c2-a51c-468d-9cd0-dac9df3a3f92 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:24.088113 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-53dfd0c2-a51c-468d-9cd0-dac9df3a3f92 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:24.088113 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-53dfd0c2-a51c-468d-9cd0-dac9df3a3f92 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:24.088113 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-53dfd0c2-a51c-468d-9cd0-dac9df3a3f92 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:24.174409 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b54717cd-202a-4e16-855c-af357e95535e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:24.174409 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b54717cd-202a-4e16-855c-af357e95535e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:24.175179 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b54717cd-202a-4e16-855c-af357e95535e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:24.175712 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b54717cd-202a-4e16-855c-af357e95535e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:24.176160 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b54717cd-202a-4e16-855c-af357e95535e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:24.177020 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b54717cd-202a-4e16-855c-af357e95535e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:24.177433 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b54717cd-202a-4e16-855c-af357e95535e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:24.178065 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b54717cd-202a-4e16-855c-af357e95535e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:24.319425 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-53dfd0c2-a51c-468d-9cd0-dac9df3a3f92 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:24.337809 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-53dfd0c2-a51c-468d-9cd0-dac9df3a3f92 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1359 microversion: 2.1 time: 0.263679 Aug 29 21:55:24.339595 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 346/693] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:24 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:24.396857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b54717cd-202a-4e16-855c-af357e95535e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:24.410819 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b54717cd-202a-4e16-855c-af357e95535e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:24.412666 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b54717cd-202a-4e16-855c-af357e95535e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:24.414655 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b54717cd-202a-4e16-855c-af357e95535e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1407 microversion: 2.20 time: 0.253077 Aug 29 21:55:24.415963 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 348/694] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:24 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:24.516432 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e5f45b49-a280-426c-be7c-38f35a3129e8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:24.518050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e5f45b49-a280-426c-be7c-38f35a3129e8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:24.531133 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5f45b49-a280-426c-be7c-38f35a3129e8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:24.532386 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5f45b49-a280-426c-be7c-38f35a3129e8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:24.533931 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5f45b49-a280-426c-be7c-38f35a3129e8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:24.536402 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5f45b49-a280-426c-be7c-38f35a3129e8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:24.537543 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5f45b49-a280-426c-be7c-38f35a3129e8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:24.539028 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e5f45b49-a280-426c-be7c-38f35a3129e8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:24.572395 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-388794135", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "networks": [{"uuid": "2295dc3b-698f-457a-94ea-bdffc1ea0b7b"}]}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:24.678105 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.network.neutron [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] validate_networks() for [('2295dc3b-698f-457a-94ea-bdffc1ea0b7b', None, None, None, None, None)] {{(pid=127882) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:55:24.766576 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e5f45b49-a280-426c-be7c-38f35a3129e8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:24.779753 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e5f45b49-a280-426c-be7c-38f35a3129e8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1736 microversion: 2.1 time: 0.270026 Aug 29 21:55:24.781585 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 347/695] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:24 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1736 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:25.083832 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-434826833", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41d7d7c2-6fcb-4be2-951b-fef278b3958e"}], "security_groups": [{"name": "tempest-securitygroup--748533259"}], "key_name": "tempest-keypair-641637025", "user_data": "}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:25.146095 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Flavor limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:55:25.147057 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Image limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:55:25.147617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Flavor pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:55:25.148034 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Image pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:55:25.148445 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:55:25.151015 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:25.160157 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:25.160884 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:25.161329 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:25.162081 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:25.162543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:25.163522 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:25.188729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Getting quotas for project 1515d87b44484ec4904ec2303c9f1f33. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:55:25.193621 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Getting quotas for user 9f617d6e3f3444cda7307794d7b8d837 and project 1515d87b44484ec4904ec2303c9f1f33. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:55:25.208427 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Going to run 1 instances... {{(pid=127882) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:55:25.211007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127882) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:55:25.229413 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.network.neutron [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] validate_networks() for [('41d7d7c2-6fcb-4be2-951b-fef278b3958e', None, None, None, None, None)] {{(pid=127883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:55:25.432684 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ba39a47d-f409-45d8-b627-65a3031a3c1f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868341 Aug 29 21:55:25.440894 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 349/696] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:55:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:55:25.440894 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-94ddb115-ade0-48f6-b977-62a76fd531cb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:25.441165 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-94ddb115-ade0-48f6-b977-62a76fd531cb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:25.456052 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94ddb115-ade0-48f6-b977-62a76fd531cb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:25.460066 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94ddb115-ade0-48f6-b977-62a76fd531cb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:25.460769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94ddb115-ade0-48f6-b977-62a76fd531cb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:25.462001 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94ddb115-ade0-48f6-b977-62a76fd531cb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:25.462405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94ddb115-ade0-48f6-b977-62a76fd531cb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:25.462999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94ddb115-ade0-48f6-b977-62a76fd531cb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:25.777652 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Flavor limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:55:25.788922 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Image limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:55:25.789708 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Flavor pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:55:25.790260 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Image pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:55:25.790900 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:55:25.801772 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:25.802258 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:25.802689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:25.803422 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:25.804543 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:25.805263 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:25.825857 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Getting quotas for project d45ce54651ad4326bccecbeea8b5b084. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:55:25.836129 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Getting quotas for user ed8ef9f9eafd4248bae86f0e8ec72731 and project d45ce54651ad4326bccecbeea8b5b084. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:55:25.854719 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Going to run 1 instances... {{(pid=127883) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:55:25.857675 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:55:25.917389 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-94ddb115-ade0-48f6-b977-62a76fd531cb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:25.926194 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-94ddb115-ade0-48f6-b977-62a76fd531cb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1549 microversion: 2.1 time: 0.489818 Aug 29 21:55:25.926771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 350/697] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:25 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1549 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:25.931388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2360e5d8-499e-4747-a844-741aceed58cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:25.932002 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2360e5d8-499e-4747-a844-741aceed58cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:25.938735 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2360e5d8-499e-4747-a844-741aceed58cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:25.939221 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2360e5d8-499e-4747-a844-741aceed58cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:25.939660 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2360e5d8-499e-4747-a844-741aceed58cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:25.940456 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2360e5d8-499e-4747-a844-741aceed58cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:25.940947 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2360e5d8-499e-4747-a844-741aceed58cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:25.941490 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2360e5d8-499e-4747-a844-741aceed58cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:25.995596 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4eaf90f8-1223-4f07-bcb5-6ad461d2a2e7 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.916045 Aug 29 21:55:25.996638 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 348/698] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:55:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:55:26.010715 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e1c67a8b-edd2-42dc-8f7c-b3580608206a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:26.010715 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e1c67a8b-edd2-42dc-8f7c-b3580608206a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:26.189425 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e1c67a8b-edd2-42dc-8f7c-b3580608206a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:26.199375 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e1c67a8b-edd2-42dc-8f7c-b3580608206a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1218 microversion: 2.1 time: 0.201495 Aug 29 21:55:26.199965 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 349/699] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:25 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1218 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:26.217692 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-265ebc32-ea5e-4793-a7ad-a97496f9b7d2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:26.218540 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-265ebc32-ea5e-4793-a7ad-a97496f9b7d2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:26.236909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-265ebc32-ea5e-4793-a7ad-a97496f9b7d2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:26.237667 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-265ebc32-ea5e-4793-a7ad-a97496f9b7d2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:26.238298 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-265ebc32-ea5e-4793-a7ad-a97496f9b7d2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:26.242579 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-265ebc32-ea5e-4793-a7ad-a97496f9b7d2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:26.242579 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-265ebc32-ea5e-4793-a7ad-a97496f9b7d2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:26.247779 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-265ebc32-ea5e-4793-a7ad-a97496f9b7d2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:26.285461 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2360e5d8-499e-4747-a844-741aceed58cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:26.319720 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2360e5d8-499e-4747-a844-741aceed58cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:26.322387 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2360e5d8-499e-4747-a844-741aceed58cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:26.324367 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2360e5d8-499e-4747-a844-741aceed58cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1407 microversion: 2.20 time: 0.396382 Aug 29 21:55:26.329307 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 351/700] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:25 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:26.334226 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-b4828017-b560-446d-9838-60b44e4a7f2b req-84c3918c-13d1-4afa-b870-02545aefb8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01db998-129a-4b44-a3c4-1da1bf023620", "name": "network-vif-plugged", "status": "completed", "tag": "95ba8615-923a-46f1-ae70-f15459156d2b"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:26.351808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-b4828017-b560-446d-9838-60b44e4a7f2b req-84c3918c-13d1-4afa-b870-02545aefb8a0 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:26.352735 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-b4828017-b560-446d-9838-60b44e4a7f2b req-84c3918c-13d1-4afa-b870-02545aefb8a0 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:26.353174 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-b4828017-b560-446d-9838-60b44e4a7f2b req-84c3918c-13d1-4afa-b870-02545aefb8a0 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:26.365741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-b4828017-b560-446d-9838-60b44e4a7f2b req-84c3918c-13d1-4afa-b870-02545aefb8a0 service nova] Creating event network-vif-plugged:95ba8615-923a-46f1-ae70-f15459156d2b for instance d01db998-129a-4b44-a3c4-1da1bf023620 on hv-cinder-85426 Aug 29 21:55:26.371210 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-b4828017-b560-446d-9838-60b44e4a7f2b req-84c3918c-13d1-4afa-b870-02545aefb8a0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040576 Aug 29 21:55:26.372222 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 352/701] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:26.381439 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e290f008-0fe9-4219-92f7-0f0d44bcd78d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:26.381439 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-e290f008-0fe9-4219-92f7-0f0d44bcd78d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:26.387089 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e290f008-0fe9-4219-92f7-0f0d44bcd78d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:26.387590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e290f008-0fe9-4219-92f7-0f0d44bcd78d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:26.388093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e290f008-0fe9-4219-92f7-0f0d44bcd78d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:26.388855 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e290f008-0fe9-4219-92f7-0f0d44bcd78d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:26.389312 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e290f008-0fe9-4219-92f7-0f0d44bcd78d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:26.389741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e290f008-0fe9-4219-92f7-0f0d44bcd78d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:26.530483 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-265ebc32-ea5e-4793-a7ad-a97496f9b7d2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:26.553141 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-265ebc32-ea5e-4793-a7ad-a97496f9b7d2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1736 microversion: 2.1 time: 0.350789 Aug 29 21:55:26.560422 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 350/702] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:26 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1736 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:26.592756 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-77fc0935-be39-474f-80ea-3409d0f474a4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:26.594487 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-77fc0935-be39-474f-80ea-3409d0f474a4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:26.623786 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e290f008-0fe9-4219-92f7-0f0d44bcd78d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:26.638529 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e290f008-0fe9-4219-92f7-0f0d44bcd78d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1549 microversion: 2.1 time: 0.263299 Aug 29 21:55:26.639313 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 353/703] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:26 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1549 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:26.666374 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0f55b36c-8e3d-43cc-9134-b0e9cc6f0fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:26.675671 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-0f55b36c-8e3d-43cc-9134-b0e9cc6f0fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:26.676994 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-0f55b36c-8e3d-43cc-9134-b0e9cc6f0fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Searching by: {'deleted': False, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20'} {{(pid=127882) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 21:55:26.689157 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0f55b36c-8e3d-43cc-9134-b0e9cc6f0fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:26.689908 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0f55b36c-8e3d-43cc-9134-b0e9cc6f0fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:26.690929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0f55b36c-8e3d-43cc-9134-b0e9cc6f0fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:26.691918 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0f55b36c-8e3d-43cc-9134-b0e9cc6f0fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:26.692372 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0f55b36c-8e3d-43cc-9134-b0e9cc6f0fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:26.693251 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0f55b36c-8e3d-43cc-9134-b0e9cc6f0fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:26.708739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-77fc0935-be39-474f-80ea-3409d0f474a4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:26.717187 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-77fc0935-be39-474f-80ea-3409d0f474a4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1236 microversion: 2.1 time: 0.154968 Aug 29 21:55:26.717775 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 351/704] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:26 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1236 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:26.818995 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.multi_cell_list [None req-0f55b36c-8e3d-43cc-9134-b0e9cc6f0fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127882) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 21:55:26.943798 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-0f55b36c-8e3d-43cc-9134-b0e9cc6f0fa9 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.285012 Aug 29 21:55:26.945908 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 354/705] 10.222.0.83 () {58 vars in 1125 bytes} [Mon Aug 29 21:55:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:26.958532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6f0c120b-be62-436f-a7a2-1c52de360ee4 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:26.959182 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6f0c120b-be62-436f-a7a2-1c52de360ee4 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:26.965763 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6f0c120b-be62-436f-a7a2-1c52de360ee4 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:26.966264 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6f0c120b-be62-436f-a7a2-1c52de360ee4 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:26.966704 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6f0c120b-be62-436f-a7a2-1c52de360ee4 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:26.967420 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6f0c120b-be62-436f-a7a2-1c52de360ee4 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:26.967873 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6f0c120b-be62-436f-a7a2-1c52de360ee4 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:26.968300 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6f0c120b-be62-436f-a7a2-1c52de360ee4 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:26.989257 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:27.238272 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-853de2e1-0924-49c8-9bd3-ee441641d37c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:27.239173 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6f0c120b-be62-436f-a7a2-1c52de360ee4 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:27.239445 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-853de2e1-0924-49c8-9bd3-ee441641d37c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:27.248947 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6f0c120b-be62-436f-a7a2-1c52de360ee4 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1549 microversion: 2.1 time: 0.294961 Aug 29 21:55:27.250274 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 352/706] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:26 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1549 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:27.251299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-853de2e1-0924-49c8-9bd3-ee441641d37c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:27.252180 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-853de2e1-0924-49c8-9bd3-ee441641d37c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:27.252676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-853de2e1-0924-49c8-9bd3-ee441641d37c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:27.253410 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-853de2e1-0924-49c8-9bd3-ee441641d37c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:27.253882 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-853de2e1-0924-49c8-9bd3-ee441641d37c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:27.254338 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-853de2e1-0924-49c8-9bd3-ee441641d37c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:27.331410 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-853de2e1-0924-49c8-9bd3-ee441641d37c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:27.340056 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-853de2e1-0924-49c8-9bd3-ee441641d37c tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1214 microversion: 2.1 time: 0.107859 Aug 29 21:55:27.340670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 355/707] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:27 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:27.357589 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-449fa2f0-adf1-4e18-afeb-686507b2259d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:27.366930 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-449fa2f0-adf1-4e18-afeb-686507b2259d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:27.366930 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-449fa2f0-adf1-4e18-afeb-686507b2259d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:27.366930 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-449fa2f0-adf1-4e18-afeb-686507b2259d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:27.366930 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-449fa2f0-adf1-4e18-afeb-686507b2259d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:27.367374 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-449fa2f0-adf1-4e18-afeb-686507b2259d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:27.367374 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-449fa2f0-adf1-4e18-afeb-686507b2259d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:27.367374 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-449fa2f0-adf1-4e18-afeb-686507b2259d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:27.509458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-449fa2f0-adf1-4e18-afeb-686507b2259d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:27.518830 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-449fa2f0-adf1-4e18-afeb-686507b2259d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:27.520281 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-449fa2f0-adf1-4e18-afeb-686507b2259d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:27.521455 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-449fa2f0-adf1-4e18-afeb-686507b2259d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1407 microversion: 2.20 time: 0.167840 Aug 29 21:55:27.522023 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 353/708] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:27 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:27.600848 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-daddbeb7-5ca0-469e-b0df-e69d24cbbae3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:27.601461 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-daddbeb7-5ca0-469e-b0df-e69d24cbbae3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:27.608059 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-daddbeb7-5ca0-469e-b0df-e69d24cbbae3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:27.608586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-daddbeb7-5ca0-469e-b0df-e69d24cbbae3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:27.609041 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-daddbeb7-5ca0-469e-b0df-e69d24cbbae3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:27.609818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-daddbeb7-5ca0-469e-b0df-e69d24cbbae3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:27.610286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-daddbeb7-5ca0-469e-b0df-e69d24cbbae3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:27.610713 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-daddbeb7-5ca0-469e-b0df-e69d24cbbae3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:27.745861 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-18e06bef-cbf5-40a2-a719-1b135f3a2a9c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:27.747022 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-18e06bef-cbf5-40a2-a719-1b135f3a2a9c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:27.757708 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-18e06bef-cbf5-40a2-a719-1b135f3a2a9c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:27.758627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-18e06bef-cbf5-40a2-a719-1b135f3a2a9c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:27.759472 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-18e06bef-cbf5-40a2-a719-1b135f3a2a9c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:27.760835 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-18e06bef-cbf5-40a2-a719-1b135f3a2a9c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:27.761611 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-18e06bef-cbf5-40a2-a719-1b135f3a2a9c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:27.762390 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-18e06bef-cbf5-40a2-a719-1b135f3a2a9c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:27.772866 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-daddbeb7-5ca0-469e-b0df-e69d24cbbae3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:27.782355 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-daddbeb7-5ca0-469e-b0df-e69d24cbbae3 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1736 microversion: 2.1 time: 0.185528 Aug 29 21:55:27.783365 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 356/709] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:27 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:27.837782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-18e06bef-cbf5-40a2-a719-1b135f3a2a9c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:27.845644 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-18e06bef-cbf5-40a2-a719-1b135f3a2a9c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1240 microversion: 2.1 time: 0.107793 Aug 29 21:55:27.846217 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 354/710] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:27 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1240 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:28.374700 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-81be9f3f-0472-46df-8de5-77b26253c096 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:28.375275 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-81be9f3f-0472-46df-8de5-77b26253c096 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:28.381984 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81be9f3f-0472-46df-8de5-77b26253c096 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:28.382470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81be9f3f-0472-46df-8de5-77b26253c096 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:28.382910 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81be9f3f-0472-46df-8de5-77b26253c096 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:28.383628 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81be9f3f-0472-46df-8de5-77b26253c096 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:28.384083 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81be9f3f-0472-46df-8de5-77b26253c096 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:28.384560 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81be9f3f-0472-46df-8de5-77b26253c096 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:28.454758 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-81be9f3f-0472-46df-8de5-77b26253c096 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:28.463941 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-81be9f3f-0472-46df-8de5-77b26253c096 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1270 microversion: 2.1 time: 0.092987 Aug 29 21:55:28.464596 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 357/711] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:28 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:28.544692 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2b27066f-cbac-44f0-8704-58cb61703ced tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:28.545370 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2b27066f-cbac-44f0-8704-58cb61703ced tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:28.553410 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b27066f-cbac-44f0-8704-58cb61703ced tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:28.554073 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b27066f-cbac-44f0-8704-58cb61703ced tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:28.554567 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b27066f-cbac-44f0-8704-58cb61703ced tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:28.555326 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b27066f-cbac-44f0-8704-58cb61703ced tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:28.556111 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b27066f-cbac-44f0-8704-58cb61703ced tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:28.556881 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2b27066f-cbac-44f0-8704-58cb61703ced tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:28.726362 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2b27066f-cbac-44f0-8704-58cb61703ced tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:28.735598 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2b27066f-cbac-44f0-8704-58cb61703ced tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:28.737126 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2b27066f-cbac-44f0-8704-58cb61703ced tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:28.738303 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2b27066f-cbac-44f0-8704-58cb61703ced tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1407 microversion: 2.20 time: 0.197632 Aug 29 21:55:28.738883 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 355/712] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:28 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:55:28.809152 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c481580c-7dac-477f-a581-aad60842c03a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:28.810440 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c481580c-7dac-477f-a581-aad60842c03a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:28.822043 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c481580c-7dac-477f-a581-aad60842c03a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:28.823026 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c481580c-7dac-477f-a581-aad60842c03a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:28.823966 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c481580c-7dac-477f-a581-aad60842c03a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:28.825518 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c481580c-7dac-477f-a581-aad60842c03a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:28.826361 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c481580c-7dac-477f-a581-aad60842c03a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:28.827170 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c481580c-7dac-477f-a581-aad60842c03a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:28.867360 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f8bb2551-6c45-437b-9291-5a1d93a90ed6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:28.868682 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f8bb2551-6c45-437b-9291-5a1d93a90ed6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:28.879045 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f8bb2551-6c45-437b-9291-5a1d93a90ed6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:28.880597 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f8bb2551-6c45-437b-9291-5a1d93a90ed6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:28.881482 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f8bb2551-6c45-437b-9291-5a1d93a90ed6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:28.883162 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f8bb2551-6c45-437b-9291-5a1d93a90ed6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:28.883830 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f8bb2551-6c45-437b-9291-5a1d93a90ed6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:28.884411 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f8bb2551-6c45-437b-9291-5a1d93a90ed6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:28.961380 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f8bb2551-6c45-437b-9291-5a1d93a90ed6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:28.973492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f8bb2551-6c45-437b-9291-5a1d93a90ed6 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1232 microversion: 2.1 time: 0.110179 Aug 29 21:55:28.974430 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 356/713] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:28 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1232 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:29.041932 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c481580c-7dac-477f-a581-aad60842c03a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:29.051237 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c481580c-7dac-477f-a581-aad60842c03a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1736 microversion: 2.1 time: 0.249938 Aug 29 21:55:29.051834 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 358/714] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:28 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1736 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:29.471038 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a8696ea3-5e51-46d5-b641-31c46ea77f1d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb20a5f9-e4e2-4916-b3c6-cdc94b7dad0a"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:29.473506 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a8696ea3-5e51-46d5-b641-31c46ea77f1d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:29.475521 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:29.480639 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a8696ea3-5e51-46d5-b641-31c46ea77f1d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:29.481133 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a8696ea3-5e51-46d5-b641-31c46ea77f1d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:29.481578 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a8696ea3-5e51-46d5-b641-31c46ea77f1d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:29.482281 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a8696ea3-5e51-46d5-b641-31c46ea77f1d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:29.482731 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a8696ea3-5e51-46d5-b641-31c46ea77f1d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:29.483216 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a8696ea3-5e51-46d5-b641-31c46ea77f1d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:29.486504 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f28c2d21-fd9e-4ed8-942b-6eedfb89242b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:29.487324 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f28c2d21-fd9e-4ed8-942b-6eedfb89242b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:29.498225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f28c2d21-fd9e-4ed8-942b-6eedfb89242b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:29.499025 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f28c2d21-fd9e-4ed8-942b-6eedfb89242b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:29.499931 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f28c2d21-fd9e-4ed8-942b-6eedfb89242b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:29.501025 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f28c2d21-fd9e-4ed8-942b-6eedfb89242b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:29.502891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f28c2d21-fd9e-4ed8-942b-6eedfb89242b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:29.503607 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f28c2d21-fd9e-4ed8-942b-6eedfb89242b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:29.618507 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f28c2d21-fd9e-4ed8-942b-6eedfb89242b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:29.629627 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f28c2d21-fd9e-4ed8-942b-6eedfb89242b tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1270 microversion: 2.1 time: 0.147789 Aug 29 21:55:29.633905 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 359/715] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:29 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:29.777052 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d39d710b-dd3e-490c-83a4-4f69284ffe6c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:29.777669 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d39d710b-dd3e-490c-83a4-4f69284ffe6c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:29.784451 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d39d710b-dd3e-490c-83a4-4f69284ffe6c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:29.785003 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d39d710b-dd3e-490c-83a4-4f69284ffe6c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:29.785444 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d39d710b-dd3e-490c-83a4-4f69284ffe6c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:29.786158 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d39d710b-dd3e-490c-83a4-4f69284ffe6c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:29.786665 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d39d710b-dd3e-490c-83a4-4f69284ffe6c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:29.787094 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d39d710b-dd3e-490c-83a4-4f69284ffe6c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:29.792737 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=100 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:29.973384 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d39d710b-dd3e-490c-83a4-4f69284ffe6c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:29.988812 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d39d710b-dd3e-490c-83a4-4f69284ffe6c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:29.992808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d39d710b-dd3e-490c-83a4-4f69284ffe6c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:29.995404 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d39d710b-dd3e-490c-83a4-4f69284ffe6c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1600 microversion: 2.20 time: 0.222436 Aug 29 21:55:30.009433 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 360/716] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:55:29 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1600 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:55:30.036271 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-230de924-4d3c-4999-a71f-cda75bfe9e23 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:30.037412 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-230de924-4d3c-4999-a71f-cda75bfe9e23 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:30.046192 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-230de924-4d3c-4999-a71f-cda75bfe9e23 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:30.046750 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-230de924-4d3c-4999-a71f-cda75bfe9e23 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:30.047616 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-230de924-4d3c-4999-a71f-cda75bfe9e23 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:30.048585 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-230de924-4d3c-4999-a71f-cda75bfe9e23 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:30.049339 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-230de924-4d3c-4999-a71f-cda75bfe9e23 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:30.050080 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-230de924-4d3c-4999-a71f-cda75bfe9e23 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:30.142248 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-230de924-4d3c-4999-a71f-cda75bfe9e23 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:30.159612 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-230de924-4d3c-4999-a71f-cda75bfe9e23 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1288 microversion: 2.1 time: 0.147816 Aug 29 21:55:30.162849 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 361/717] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:30 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1288 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:30.169185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d1356d40-c7f3-4551-976d-887e0cb1fe54 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:30.169909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d1356d40-c7f3-4551-976d-887e0cb1fe54 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:30.189309 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d1356d40-c7f3-4551-976d-887e0cb1fe54 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:30.190598 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d1356d40-c7f3-4551-976d-887e0cb1fe54 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:30.190598 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d1356d40-c7f3-4551-976d-887e0cb1fe54 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:30.192036 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d1356d40-c7f3-4551-976d-887e0cb1fe54 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:30.192036 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d1356d40-c7f3-4551-976d-887e0cb1fe54 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:30.192499 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d1356d40-c7f3-4551-976d-887e0cb1fe54 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:30.291803 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d1356d40-c7f3-4551-976d-887e0cb1fe54 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.127583 Aug 29 21:55:30.292465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 362/718] 10.222.0.83 () {60 vars in 1316 bytes} [Mon Aug 29 21:55:30 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:55:30.304949 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-372444f6-a143-4b66-a275-92ca84d7f5ec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:30.305594 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-372444f6-a143-4b66-a275-92ca84d7f5ec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:30.312343 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-372444f6-a143-4b66-a275-92ca84d7f5ec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:30.312885 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-372444f6-a143-4b66-a275-92ca84d7f5ec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:30.313835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-372444f6-a143-4b66-a275-92ca84d7f5ec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:30.314305 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-372444f6-a143-4b66-a275-92ca84d7f5ec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:30.314966 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-372444f6-a143-4b66-a275-92ca84d7f5ec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:30.315402 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-372444f6-a143-4b66-a275-92ca84d7f5ec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:30.603677 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-372444f6-a143-4b66-a275-92ca84d7f5ec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:30.623144 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-372444f6-a143-4b66-a275-92ca84d7f5ec tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1736 microversion: 2.1 time: 0.324267 Aug 29 21:55:30.623835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 363/719] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:30 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1736 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:30.673162 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-36adce49-d3b1-40d8-8d84-199bdba83bd2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:30.674287 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-36adce49-d3b1-40d8-8d84-199bdba83bd2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:30.684967 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-36adce49-d3b1-40d8-8d84-199bdba83bd2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:30.685892 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-36adce49-d3b1-40d8-8d84-199bdba83bd2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:30.686985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-36adce49-d3b1-40d8-8d84-199bdba83bd2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:30.688080 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-36adce49-d3b1-40d8-8d84-199bdba83bd2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:30.689478 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-36adce49-d3b1-40d8-8d84-199bdba83bd2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:30.690096 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-36adce49-d3b1-40d8-8d84-199bdba83bd2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:30.773364 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a8696ea3-5e51-46d5-b641-31c46ea77f1d tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "POST /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.306058 Aug 29 21:55:30.781237 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 357/720] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 21:55:29 2022] POST /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/os-volume_attachments => generated 194 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:31.142375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-36adce49-d3b1-40d8-8d84-199bdba83bd2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:31.168528 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-36adce49-d3b1-40d8-8d84-199bdba83bd2 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1318 microversion: 2.1 time: 0.507665 Aug 29 21:55:31.169005 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 364/721] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:30 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1318 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:31.188953 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-068c2100-465c-4058-ba55-370022541f7e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:31.189987 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-068c2100-465c-4058-ba55-370022541f7e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:31.198508 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-068c2100-465c-4058-ba55-370022541f7e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:31.199534 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-068c2100-465c-4058-ba55-370022541f7e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:31.200202 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-068c2100-465c-4058-ba55-370022541f7e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:31.201185 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-068c2100-465c-4058-ba55-370022541f7e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:31.201795 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-068c2100-465c-4058-ba55-370022541f7e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:31.202468 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-068c2100-465c-4058-ba55-370022541f7e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:31.592945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-068c2100-465c-4058-ba55-370022541f7e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:31.614276 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-068c2100-465c-4058-ba55-370022541f7e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1296 microversion: 2.1 time: 0.428720 Aug 29 21:55:31.622085 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 358/722] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:31 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1296 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:31.645684 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-793357e8-2580-4859-903f-1f336972b2c8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:31.647026 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-793357e8-2580-4859-903f-1f336972b2c8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:31.657087 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-793357e8-2580-4859-903f-1f336972b2c8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:31.657876 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-793357e8-2580-4859-903f-1f336972b2c8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:31.659079 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-793357e8-2580-4859-903f-1f336972b2c8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:31.659801 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-793357e8-2580-4859-903f-1f336972b2c8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:31.661466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-793357e8-2580-4859-903f-1f336972b2c8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:31.662155 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-793357e8-2580-4859-903f-1f336972b2c8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:31.932173 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-793357e8-2580-4859-903f-1f336972b2c8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:31.956842 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-793357e8-2580-4859-903f-1f336972b2c8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1736 microversion: 2.1 time: 0.308399 Aug 29 21:55:31.963240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 365/723] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:31 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1736 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:32.104993 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-8c7755fc-2771-4cbc-9f01-4bee49d21212 req-86f63a54-4a02-4c68-a029-14a929a71acf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d01db998-129a-4b44-a3c4-1da1bf023620", "tag": "95ba8615-923a-46f1-ae70-f15459156d2b"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:32.119465 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-8c7755fc-2771-4cbc-9f01-4bee49d21212 req-86f63a54-4a02-4c68-a029-14a929a71acf service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:32.120162 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-8c7755fc-2771-4cbc-9f01-4bee49d21212 req-86f63a54-4a02-4c68-a029-14a929a71acf service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:32.120619 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-8c7755fc-2771-4cbc-9f01-4bee49d21212 req-86f63a54-4a02-4c68-a029-14a929a71acf service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:32.134887 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-8c7755fc-2771-4cbc-9f01-4bee49d21212 req-86f63a54-4a02-4c68-a029-14a929a71acf service nova] Creating event network-changed:95ba8615-923a-46f1-ae70-f15459156d2b for instance d01db998-129a-4b44-a3c4-1da1bf023620 on hv-cinder-85426 Aug 29 21:55:32.140168 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-8c7755fc-2771-4cbc-9f01-4bee49d21212 req-86f63a54-4a02-4c68-a029-14a929a71acf service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040933 Aug 29 21:55:32.141072 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 359/724] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:32.199283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4b588660-98a1-44a6-b1ed-c07e5827a40a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:32.200644 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4b588660-98a1-44a6-b1ed-c07e5827a40a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:32.212577 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b588660-98a1-44a6-b1ed-c07e5827a40a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:32.213433 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b588660-98a1-44a6-b1ed-c07e5827a40a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:32.214444 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b588660-98a1-44a6-b1ed-c07e5827a40a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:32.215813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b588660-98a1-44a6-b1ed-c07e5827a40a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:32.216958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b588660-98a1-44a6-b1ed-c07e5827a40a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:32.217671 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b588660-98a1-44a6-b1ed-c07e5827a40a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:32.426289 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4b588660-98a1-44a6-b1ed-c07e5827a40a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:32.440591 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4b588660-98a1-44a6-b1ed-c07e5827a40a tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1318 microversion: 2.1 time: 0.249400 Aug 29 21:55:32.442534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 366/725] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:32 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:32.515093 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-22d2bc09-6f1d-4527-a376-fddb7460d452 req-5f9eae10-e8cf-431f-a661-5a14dfec7967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "315eda88-f51d-4b3a-8ff1-fdf6445d029c", "tag": "dffc19a7-1747-4f43-8267-b48210d30291"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:32.568412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-22d2bc09-6f1d-4527-a376-fddb7460d452 req-5f9eae10-e8cf-431f-a661-5a14dfec7967 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:32.570808 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-22d2bc09-6f1d-4527-a376-fddb7460d452 req-5f9eae10-e8cf-431f-a661-5a14dfec7967 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:32.573311 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-22d2bc09-6f1d-4527-a376-fddb7460d452 req-5f9eae10-e8cf-431f-a661-5a14dfec7967 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:32.587547 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-22d2bc09-6f1d-4527-a376-fddb7460d452 req-5f9eae10-e8cf-431f-a661-5a14dfec7967 service nova] Creating event network-changed:dffc19a7-1747-4f43-8267-b48210d30291 for instance 315eda88-f51d-4b3a-8ff1-fdf6445d029c on hv-cinder-85426 Aug 29 21:55:32.594674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-22d2bc09-6f1d-4527-a376-fddb7460d452 req-5f9eae10-e8cf-431f-a661-5a14dfec7967 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091764 Aug 29 21:55:32.595486 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 360/726] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:32.652008 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2737ae15-9014-4136-8093-9d0f7657544f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:32.652674 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2737ae15-9014-4136-8093-9d0f7657544f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:32.659490 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2737ae15-9014-4136-8093-9d0f7657544f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:32.661608 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2737ae15-9014-4136-8093-9d0f7657544f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:32.662300 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2737ae15-9014-4136-8093-9d0f7657544f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:32.663432 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2737ae15-9014-4136-8093-9d0f7657544f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:32.669732 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2737ae15-9014-4136-8093-9d0f7657544f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:32.670414 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2737ae15-9014-4136-8093-9d0f7657544f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:32.782089 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2737ae15-9014-4136-8093-9d0f7657544f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:32.785896 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2737ae15-9014-4136-8093-9d0f7657544f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1294 microversion: 2.1 time: 0.138531 Aug 29 21:55:32.804681 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 367/727] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:32 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1294 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:32.972894 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-be5dc53a-0f59-433e-b7f4-d78c9fced2aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:32.976046 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-be5dc53a-0f59-433e-b7f4-d78c9fced2aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:32.994722 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be5dc53a-0f59-433e-b7f4-d78c9fced2aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:32.995375 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be5dc53a-0f59-433e-b7f4-d78c9fced2aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:32.995827 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be5dc53a-0f59-433e-b7f4-d78c9fced2aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:32.996562 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be5dc53a-0f59-433e-b7f4-d78c9fced2aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:33.011465 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be5dc53a-0f59-433e-b7f4-d78c9fced2aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:33.011750 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be5dc53a-0f59-433e-b7f4-d78c9fced2aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:33.244805 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-be5dc53a-0f59-433e-b7f4-d78c9fced2aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:33.251503 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-be5dc53a-0f59-433e-b7f4-d78c9fced2aa tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1736 microversion: 2.1 time: 0.282730 Aug 29 21:55:33.256079 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 361/728] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:32 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1736 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:33.476516 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-26e59576-0abb-4601-b093-c378a61e6150 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:33.477946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-26e59576-0abb-4601-b093-c378a61e6150 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:33.489011 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-26e59576-0abb-4601-b093-c378a61e6150 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:33.489681 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-26e59576-0abb-4601-b093-c378a61e6150 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:33.490215 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-26e59576-0abb-4601-b093-c378a61e6150 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:33.491739 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-26e59576-0abb-4601-b093-c378a61e6150 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:33.492775 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-26e59576-0abb-4601-b093-c378a61e6150 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:33.493321 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-26e59576-0abb-4601-b093-c378a61e6150 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:33.715002 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-26e59576-0abb-4601-b093-c378a61e6150 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:33.728394 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-26e59576-0abb-4601-b093-c378a61e6150 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1318 microversion: 2.1 time: 0.258559 Aug 29 21:55:33.729393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 368/729] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:33 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:33.811316 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-321ff260-c9b2-4781-a47f-dcec31d25773 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:33.811946 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-321ff260-c9b2-4781-a47f-dcec31d25773 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:33.835265 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-321ff260-c9b2-4781-a47f-dcec31d25773 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:33.835265 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-321ff260-c9b2-4781-a47f-dcec31d25773 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:33.835265 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-321ff260-c9b2-4781-a47f-dcec31d25773 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:33.836371 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-321ff260-c9b2-4781-a47f-dcec31d25773 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:33.836667 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-321ff260-c9b2-4781-a47f-dcec31d25773 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:33.836975 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-321ff260-c9b2-4781-a47f-dcec31d25773 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:34.274822 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0780cd43-5f67-4c73-b790-c3a25aa0a388 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:34.275465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-0780cd43-5f67-4c73-b790-c3a25aa0a388 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:34.284290 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0780cd43-5f67-4c73-b790-c3a25aa0a388 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:34.285005 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0780cd43-5f67-4c73-b790-c3a25aa0a388 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:34.285521 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0780cd43-5f67-4c73-b790-c3a25aa0a388 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:34.287217 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0780cd43-5f67-4c73-b790-c3a25aa0a388 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:34.288035 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0780cd43-5f67-4c73-b790-c3a25aa0a388 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:34.288918 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0780cd43-5f67-4c73-b790-c3a25aa0a388 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:34.375939 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-321ff260-c9b2-4781-a47f-dcec31d25773 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:34.392926 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-321ff260-c9b2-4781-a47f-dcec31d25773 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1361 microversion: 2.1 time: 0.584538 Aug 29 21:55:34.401989 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 362/730] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:33 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1361 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:34.485052 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-0780cd43-5f67-4c73-b790-c3a25aa0a388 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:34.502238 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-0780cd43-5f67-4c73-b790-c3a25aa0a388 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1736 microversion: 2.1 time: 0.231481 Aug 29 21:55:34.504273 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 369/731] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:34 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:34.750741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ce8e5244-c122-4fa5-bda4-7264a26af8b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:34.751169 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ce8e5244-c122-4fa5-bda4-7264a26af8b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:34.763803 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ce8e5244-c122-4fa5-bda4-7264a26af8b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:34.764665 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ce8e5244-c122-4fa5-bda4-7264a26af8b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:34.766312 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ce8e5244-c122-4fa5-bda4-7264a26af8b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:34.767334 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ce8e5244-c122-4fa5-bda4-7264a26af8b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:34.767827 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ce8e5244-c122-4fa5-bda4-7264a26af8b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:34.768723 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ce8e5244-c122-4fa5-bda4-7264a26af8b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:35.092820 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ce8e5244-c122-4fa5-bda4-7264a26af8b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:35.112261 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ce8e5244-c122-4fa5-bda4-7264a26af8b3 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1318 microversion: 2.1 time: 0.365168 Aug 29 21:55:35.138018 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 363/732] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:34 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:35.421688 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a667c612-9952-45f8-a9fc-e422f15ee746 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:35.422548 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e6ad1632-eb70-4683-8a06-18f9afa25d19 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:35.423457 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-e6ad1632-eb70-4683-8a06-18f9afa25d19 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:35.423965 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a667c612-9952-45f8-a9fc-e422f15ee746 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:35.427670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=10 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:35.435043 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a667c612-9952-45f8-a9fc-e422f15ee746 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:35.435992 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a667c612-9952-45f8-a9fc-e422f15ee746 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:35.436456 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a667c612-9952-45f8-a9fc-e422f15ee746 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:35.437251 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a667c612-9952-45f8-a9fc-e422f15ee746 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:35.437806 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a667c612-9952-45f8-a9fc-e422f15ee746 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:35.438214 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a667c612-9952-45f8-a9fc-e422f15ee746 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:35.444036 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6ad1632-eb70-4683-8a06-18f9afa25d19 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:35.445360 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6ad1632-eb70-4683-8a06-18f9afa25d19 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:35.446671 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6ad1632-eb70-4683-8a06-18f9afa25d19 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:35.447472 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6ad1632-eb70-4683-8a06-18f9afa25d19 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:35.448407 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6ad1632-eb70-4683-8a06-18f9afa25d19 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:35.458004 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e6ad1632-eb70-4683-8a06-18f9afa25d19 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:35.625647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a667c612-9952-45f8-a9fc-e422f15ee746 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:35.641198 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a667c612-9952-45f8-a9fc-e422f15ee746 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1595 microversion: 2.1 time: 0.223696 Aug 29 21:55:35.641923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 364/733] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:35 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1595 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:35.641923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-15dac2f8-2898-414e-96a0-ee7304288204 req-dcd3edbd-6413-40fa-a644-23ccd2c70a5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aeae90c-192c-4d96-833e-2e4cdf0538f9", "tag": "4adb0541-9c38-4289-8fb7-313fc3bc11be"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:35.664905 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e6ad1632-eb70-4683-8a06-18f9afa25d19 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:35.666384 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-15dac2f8-2898-414e-96a0-ee7304288204 req-dcd3edbd-6413-40fa-a644-23ccd2c70a5f service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:35.666985 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-15dac2f8-2898-414e-96a0-ee7304288204 req-dcd3edbd-6413-40fa-a644-23ccd2c70a5f service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:35.667425 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-15dac2f8-2898-414e-96a0-ee7304288204 req-dcd3edbd-6413-40fa-a644-23ccd2c70a5f service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:35.667896 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e6ad1632-eb70-4683-8a06-18f9afa25d19 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1361 microversion: 2.1 time: 0.255531 Aug 29 21:55:35.670182 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 370/734] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:35 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:35.680703 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-794d42bf-5e3a-450d-bf2b-e53169c80aa1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:35.680703 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-794d42bf-5e3a-450d-bf2b-e53169c80aa1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:35.683327 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-794d42bf-5e3a-450d-bf2b-e53169c80aa1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:35.684096 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-794d42bf-5e3a-450d-bf2b-e53169c80aa1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:35.684867 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-794d42bf-5e3a-450d-bf2b-e53169c80aa1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:35.685912 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-794d42bf-5e3a-450d-bf2b-e53169c80aa1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:35.687465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-794d42bf-5e3a-450d-bf2b-e53169c80aa1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:35.688413 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-794d42bf-5e3a-450d-bf2b-e53169c80aa1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:35.689987 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-15dac2f8-2898-414e-96a0-ee7304288204 req-dcd3edbd-6413-40fa-a644-23ccd2c70a5f service nova] Creating event network-changed:4adb0541-9c38-4289-8fb7-313fc3bc11be for instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 on hv-cinder-85426 Aug 29 21:55:35.697562 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-15dac2f8-2898-414e-96a0-ee7304288204 req-dcd3edbd-6413-40fa-a644-23ccd2c70a5f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050229 Aug 29 21:55:35.701536 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 365/735] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:35.883183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-794d42bf-5e3a-450d-bf2b-e53169c80aa1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:35.891912 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-794d42bf-5e3a-450d-bf2b-e53169c80aa1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1736 microversion: 2.1 time: 0.222315 Aug 29 21:55:35.893258 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 371/736] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:35 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:36.136117 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8eb1a0e8-b2ae-4878-a133-f5d8d28b6bea tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:36.136955 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-8eb1a0e8-b2ae-4878-a133-f5d8d28b6bea tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:36.139459 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:36.155094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8eb1a0e8-b2ae-4878-a133-f5d8d28b6bea tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:36.158071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8eb1a0e8-b2ae-4878-a133-f5d8d28b6bea tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:36.158626 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8eb1a0e8-b2ae-4878-a133-f5d8d28b6bea tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:36.159456 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8eb1a0e8-b2ae-4878-a133-f5d8d28b6bea tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:36.160056 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8eb1a0e8-b2ae-4878-a133-f5d8d28b6bea tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:36.162364 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8eb1a0e8-b2ae-4878-a133-f5d8d28b6bea tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:36.573639 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-8eb1a0e8-b2ae-4878-a133-f5d8d28b6bea tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:36.582253 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-8eb1a0e8-b2ae-4878-a133-f5d8d28b6bea tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1318 microversion: 2.1 time: 0.450992 Aug 29 21:55:36.582840 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 366/737] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:36 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:36.701615 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9b458e9b-c854-4f3b-ab7f-183d5f0e8c7b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:36.702240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9b458e9b-c854-4f3b-ab7f-183d5f0e8c7b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:36.712605 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9b458e9b-c854-4f3b-ab7f-183d5f0e8c7b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:36.713469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9b458e9b-c854-4f3b-ab7f-183d5f0e8c7b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:36.714154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9b458e9b-c854-4f3b-ab7f-183d5f0e8c7b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:36.714850 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9b458e9b-c854-4f3b-ab7f-183d5f0e8c7b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:36.715345 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9b458e9b-c854-4f3b-ab7f-183d5f0e8c7b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:36.715882 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9b458e9b-c854-4f3b-ab7f-183d5f0e8c7b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:36.734375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=4 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:36.914623 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-39d2549d-8851-4897-b057-45d1337d6547 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:36.915427 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-39d2549d-8851-4897-b057-45d1337d6547 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:36.917341 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=10 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:36.923240 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-39d2549d-8851-4897-b057-45d1337d6547 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:36.923915 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-39d2549d-8851-4897-b057-45d1337d6547 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:36.924576 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-39d2549d-8851-4897-b057-45d1337d6547 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:36.925616 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-39d2549d-8851-4897-b057-45d1337d6547 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:36.926199 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-39d2549d-8851-4897-b057-45d1337d6547 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:36.926698 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-39d2549d-8851-4897-b057-45d1337d6547 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:36.987643 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9b458e9b-c854-4f3b-ab7f-183d5f0e8c7b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:37.000349 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9b458e9b-c854-4f3b-ab7f-183d5f0e8c7b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1361 microversion: 2.1 time: 0.302648 Aug 29 21:55:37.007304 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 372/738] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:36 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1361 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:37.160575 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-39d2549d-8851-4897-b057-45d1337d6547 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:37.173420 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-39d2549d-8851-4897-b057-45d1337d6547 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1716 microversion: 2.1 time: 0.263178 Aug 29 21:55:37.174266 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 367/739] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:36 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1716 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:37.313687 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f0eb9d67-93b9-4569-a8dd-577699c957f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:37.314177 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f0eb9d67-93b9-4569-a8dd-577699c957f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:37.320295 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f0eb9d67-93b9-4569-a8dd-577699c957f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:37.320823 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f0eb9d67-93b9-4569-a8dd-577699c957f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:37.321392 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f0eb9d67-93b9-4569-a8dd-577699c957f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:37.322093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f0eb9d67-93b9-4569-a8dd-577699c957f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:37.322545 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f0eb9d67-93b9-4569-a8dd-577699c957f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:37.322972 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f0eb9d67-93b9-4569-a8dd-577699c957f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:37.418889 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-f0eb9d67-93b9-4569-a8dd-577699c957f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] HTTP exception thrown: Cannot 'detach_volume' instance 945580b2-8dd8-43c7-a485-9501fd158032 while it is in vm_state rescued Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f0eb9d67-93b9-4569-a8dd-577699c957f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Request method failure captured: Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: DELETE /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-volume_attachments/43ccf79f-6fb7-4b0d-bf5c-3544769e9eaf HTTP/1.1 Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTUBV54KXufTxPgBAlndN0DEguNRKzSRmEC5xewb2lPPOimeyFRSKSE-6O1bForpBT9-ggR6RsNJabRPmDZZQOEUgzIPpDU_UHM7JinN8BmN7CaDpBTpPmSAVaL8wDeAim5TRDVnE7RSL44Ykqa0DQF0eZupQ_CRNGNzjBu6MIoH0-w Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: f8ca070dc59e4a69bdaca0150f92bcc4 Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1630666147 Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:55:37.420670 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:55:37.423946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:55:37.423946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1630666147 Aug 29 21:55:37.423946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: f8ca070dc59e4a69bdaca0150f92bcc4 Aug 29 21:55:37.423946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1630666147 Aug 29 21:55:37.423946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-ServerRescueNegativeTestJSON-1630666147-project Aug 29 21:55:37.423946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:55:37.423946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:55:37.423946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 3575098818954a949e202397a1b20a6a Aug 29 21:55:37.423946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1630666147-project Aug 29 21:55:37.423946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:55:37.423946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Cannot 'detach_volume' instance 945580b2-8dd8-43c7-a485-9501fd158032 while it is in vm_state rescued Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'server_id': '945580b2-8dd8-43c7-a485-9501fd158032', 'id': '43ccf79f-6fb7-4b0d-bf5c-3544769e9eaf'} Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 945580b2-8dd8-43c7-a485-9501fd158032 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:55:37.425405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 945580b2-8dd8-43c7-a485-9501fd158032 while it is in vm_state rescued Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 945580b2-8dd8-43c7-a485-9501fd158032 while it is in vm_state rescued Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:55:37.428465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f0eb9d67-93b9-4569-a8dd-577699c957f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Returning 409 to user: Cannot 'detach_volume' instance 945580b2-8dd8-43c7-a485-9501fd158032 while it is in vm_state rescued {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:55:37.434797 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f0eb9d67-93b9-4569-a8dd-577699c957f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "DELETE /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-volume_attachments/43ccf79f-6fb7-4b0d-bf5c-3544769e9eaf" status: 409 len: 152 microversion: 2.1 time: 0.113358 Aug 29 21:55:37.434797 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 373/740] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 21:55:37 2022] DELETE /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-volume_attachments/43ccf79f-6fb7-4b0d-bf5c-3544769e9eaf => generated 152 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 21:55:37.435108 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-03cb5333-7649-43dd-ad7c-4d382737e567 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:37.435522 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-03cb5333-7649-43dd-ad7c-4d382737e567 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:37.442465 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-03cb5333-7649-43dd-ad7c-4d382737e567 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:37.443540 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-03cb5333-7649-43dd-ad7c-4d382737e567 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:37.443540 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-03cb5333-7649-43dd-ad7c-4d382737e567 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:37.444750 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-03cb5333-7649-43dd-ad7c-4d382737e567 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:37.445213 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-03cb5333-7649-43dd-ad7c-4d382737e567 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:37.445642 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-03cb5333-7649-43dd-ad7c-4d382737e567 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:37.605011 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2446017b-6ace-4161-a00f-aa6b8b1ae12f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:37.605636 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2446017b-6ace-4161-a00f-aa6b8b1ae12f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:37.608858 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:37.615379 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2446017b-6ace-4161-a00f-aa6b8b1ae12f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:37.615910 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2446017b-6ace-4161-a00f-aa6b8b1ae12f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:37.616476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2446017b-6ace-4161-a00f-aa6b8b1ae12f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:37.617271 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2446017b-6ace-4161-a00f-aa6b8b1ae12f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:37.617741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2446017b-6ace-4161-a00f-aa6b8b1ae12f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:37.618167 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2446017b-6ace-4161-a00f-aa6b8b1ae12f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:37.708210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-03cb5333-7649-43dd-ad7c-4d382737e567 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "POST /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/action" status: 202 len: 0 microversion: 2.1 time: 0.277776 Aug 29 21:55:37.714331 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 368/741] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 21:55:37 2022] POST /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:55:37.723038 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-60db1d9f-80f7-4e31-bc11-835d697696ce tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:37.723923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-60db1d9f-80f7-4e31-bc11-835d697696ce tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:37.731390 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-60db1d9f-80f7-4e31-bc11-835d697696ce tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:37.731902 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-60db1d9f-80f7-4e31-bc11-835d697696ce tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:37.732358 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-60db1d9f-80f7-4e31-bc11-835d697696ce tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:37.733157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-60db1d9f-80f7-4e31-bc11-835d697696ce tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:37.733632 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-60db1d9f-80f7-4e31-bc11-835d697696ce tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:37.734074 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-60db1d9f-80f7-4e31-bc11-835d697696ce tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:37.837257 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2446017b-6ace-4161-a00f-aa6b8b1ae12f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:37.840158 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2446017b-6ace-4161-a00f-aa6b8b1ae12f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1318 microversion: 2.1 time: 0.239710 Aug 29 21:55:37.840791 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 374/742] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:37 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:38.035677 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4b25133c-9ca5-443b-89c4-1428c612b956 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:38.039495 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-60db1d9f-80f7-4e31-bc11-835d697696ce tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:38.047300 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4b25133c-9ca5-443b-89c4-1428c612b956 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:38.062610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b25133c-9ca5-443b-89c4-1428c612b956 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:38.063751 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-60db1d9f-80f7-4e31-bc11-835d697696ce tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1724 microversion: 2.1 time: 0.347108 Aug 29 21:55:38.064687 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b25133c-9ca5-443b-89c4-1428c612b956 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:38.065723 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b25133c-9ca5-443b-89c4-1428c612b956 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:38.067547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b25133c-9ca5-443b-89c4-1428c612b956 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:38.070052 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b25133c-9ca5-443b-89c4-1428c612b956 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:38.071488 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b25133c-9ca5-443b-89c4-1428c612b956 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:38.078113 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 369/743] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:37 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:38.486209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4b25133c-9ca5-443b-89c4-1428c612b956 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:38.507356 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4b25133c-9ca5-443b-89c4-1428c612b956 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1361 microversion: 2.1 time: 0.480360 Aug 29 21:55:38.509259 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 375/744] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:38 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1361 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:38.867312 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b6ca11bc-14fe-4bdb-ab23-e98f820fc451 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:38.869434 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b6ca11bc-14fe-4bdb-ab23-e98f820fc451 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:38.881668 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6ca11bc-14fe-4bdb-ab23-e98f820fc451 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:38.883324 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6ca11bc-14fe-4bdb-ab23-e98f820fc451 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:38.883978 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6ca11bc-14fe-4bdb-ab23-e98f820fc451 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:38.885288 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6ca11bc-14fe-4bdb-ab23-e98f820fc451 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:38.886154 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6ca11bc-14fe-4bdb-ab23-e98f820fc451 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:38.886880 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b6ca11bc-14fe-4bdb-ab23-e98f820fc451 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:38.990544 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-414805be-cbac-4586-a8f3-0a2f299c5ab8 req-ab8a22ed-d22e-4564-bf51-0e184223bc7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9b91c1-cfde-4d81-ac00-b83f8b333df9", "tag": "b88a29b5-ab90-482e-8b10-2c1389ed5c8b"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:39.002182 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-414805be-cbac-4586-a8f3-0a2f299c5ab8 req-ab8a22ed-d22e-4564-bf51-0e184223bc7f service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:39.003162 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-414805be-cbac-4586-a8f3-0a2f299c5ab8 req-ab8a22ed-d22e-4564-bf51-0e184223bc7f service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:39.003810 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-414805be-cbac-4586-a8f3-0a2f299c5ab8 req-ab8a22ed-d22e-4564-bf51-0e184223bc7f service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:39.018207 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-414805be-cbac-4586-a8f3-0a2f299c5ab8 req-ab8a22ed-d22e-4564-bf51-0e184223bc7f service nova] Creating event network-changed:b88a29b5-ab90-482e-8b10-2c1389ed5c8b for instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 on hv-cinder-85426 Aug 29 21:55:39.025703 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-414805be-cbac-4586-a8f3-0a2f299c5ab8 req-ab8a22ed-d22e-4564-bf51-0e184223bc7f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037654 Aug 29 21:55:39.026187 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 376/745] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:39.111784 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-1ac24a77-d8c4-4c77-81fd-ad01e0182d52 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:39.114056 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-1ac24a77-d8c4-4c77-81fd-ad01e0182d52 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:39.133311 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1ac24a77-d8c4-4c77-81fd-ad01e0182d52 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:39.134291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1ac24a77-d8c4-4c77-81fd-ad01e0182d52 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:39.135172 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1ac24a77-d8c4-4c77-81fd-ad01e0182d52 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:39.136536 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1ac24a77-d8c4-4c77-81fd-ad01e0182d52 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:39.137603 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1ac24a77-d8c4-4c77-81fd-ad01e0182d52 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:39.138260 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1ac24a77-d8c4-4c77-81fd-ad01e0182d52 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:39.210677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b6ca11bc-14fe-4bdb-ab23-e98f820fc451 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:39.224182 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b6ca11bc-14fe-4bdb-ab23-e98f820fc451 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1318 microversion: 2.1 time: 0.364167 Aug 29 21:55:39.225854 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 370/746] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:38 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:39.353767 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1ac24a77-d8c4-4c77-81fd-ad01e0182d52 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:39.357619 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=100 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:39.363056 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-1ac24a77-d8c4-4c77-81fd-ad01e0182d52 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1724 microversion: 2.1 time: 0.269340 Aug 29 21:55:39.363729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 377/747] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:39 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:39.552985 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d68b9049-7e21-4cbc-9b47-56645cc78868 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:39.554270 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d68b9049-7e21-4cbc-9b47-56645cc78868 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:39.560524 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d68b9049-7e21-4cbc-9b47-56645cc78868 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:39.561294 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d68b9049-7e21-4cbc-9b47-56645cc78868 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:39.561713 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d68b9049-7e21-4cbc-9b47-56645cc78868 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:39.562442 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d68b9049-7e21-4cbc-9b47-56645cc78868 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:39.562947 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d68b9049-7e21-4cbc-9b47-56645cc78868 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:39.563317 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d68b9049-7e21-4cbc-9b47-56645cc78868 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:39.746666 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d68b9049-7e21-4cbc-9b47-56645cc78868 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:39.756767 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d68b9049-7e21-4cbc-9b47-56645cc78868 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1361 microversion: 2.1 time: 0.207990 Aug 29 21:55:39.757672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 371/748] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:39 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:40.251911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2c3a6619-1097-48ec-a03e-e8ef8ab24658 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:40.253422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2c3a6619-1097-48ec-a03e-e8ef8ab24658 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:40.265643 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2c3a6619-1097-48ec-a03e-e8ef8ab24658 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:40.267318 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2c3a6619-1097-48ec-a03e-e8ef8ab24658 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:40.268579 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2c3a6619-1097-48ec-a03e-e8ef8ab24658 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:40.269821 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2c3a6619-1097-48ec-a03e-e8ef8ab24658 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:40.270655 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2c3a6619-1097-48ec-a03e-e8ef8ab24658 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:40.272198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2c3a6619-1097-48ec-a03e-e8ef8ab24658 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:40.386913 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-9980fdef-ba52-4886-a85f-7393ff171f1d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:40.388430 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-9980fdef-ba52-4886-a85f-7393ff171f1d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:40.396211 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9980fdef-ba52-4886-a85f-7393ff171f1d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:40.397632 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9980fdef-ba52-4886-a85f-7393ff171f1d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:40.398551 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9980fdef-ba52-4886-a85f-7393ff171f1d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:40.399576 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9980fdef-ba52-4886-a85f-7393ff171f1d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:40.400392 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9980fdef-ba52-4886-a85f-7393ff171f1d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:40.401353 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9980fdef-ba52-4886-a85f-7393ff171f1d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:40.474883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2c3a6619-1097-48ec-a03e-e8ef8ab24658 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:40.484118 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2c3a6619-1097-48ec-a03e-e8ef8ab24658 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1318 microversion: 2.1 time: 0.236905 Aug 29 21:55:40.484772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 378/749] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:40 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:40.649830 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9980fdef-ba52-4886-a85f-7393ff171f1d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:40.658817 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-9980fdef-ba52-4886-a85f-7393ff171f1d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1724 microversion: 2.1 time: 0.275757 Aug 29 21:55:40.659403 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 372/750] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:40 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:40.795479 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4b720c2b-dd10-4562-9c76-47ad9033fdc2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:40.796151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4b720c2b-dd10-4562-9c76-47ad9033fdc2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:40.804512 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b720c2b-dd10-4562-9c76-47ad9033fdc2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:40.807305 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b720c2b-dd10-4562-9c76-47ad9033fdc2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:40.811235 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b720c2b-dd10-4562-9c76-47ad9033fdc2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:40.817977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b720c2b-dd10-4562-9c76-47ad9033fdc2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:40.817977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b720c2b-dd10-4562-9c76-47ad9033fdc2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:40.817977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4b720c2b-dd10-4562-9c76-47ad9033fdc2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:40.981813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4b720c2b-dd10-4562-9c76-47ad9033fdc2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:40.993198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4b720c2b-dd10-4562-9c76-47ad9033fdc2 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1361 microversion: 2.1 time: 0.201535 Aug 29 21:55:40.994016 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 379/751] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:40 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:41.520053 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-eb2a0ddd-132d-43c7-9efa-92d3fdf2624f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:41.521264 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-eb2a0ddd-132d-43c7-9efa-92d3fdf2624f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:41.532984 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eb2a0ddd-132d-43c7-9efa-92d3fdf2624f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:41.533844 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eb2a0ddd-132d-43c7-9efa-92d3fdf2624f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:41.548798 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eb2a0ddd-132d-43c7-9efa-92d3fdf2624f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:41.548798 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eb2a0ddd-132d-43c7-9efa-92d3fdf2624f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:41.548798 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eb2a0ddd-132d-43c7-9efa-92d3fdf2624f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:41.548798 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eb2a0ddd-132d-43c7-9efa-92d3fdf2624f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:41.703861 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-70202982-528e-4af6-b51a-b407e6e939e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:41.703861 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-70202982-528e-4af6-b51a-b407e6e939e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:41.703861 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-70202982-528e-4af6-b51a-b407e6e939e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:41.703861 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-70202982-528e-4af6-b51a-b407e6e939e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:41.705069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-70202982-528e-4af6-b51a-b407e6e939e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:41.705069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-70202982-528e-4af6-b51a-b407e6e939e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:41.705069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-70202982-528e-4af6-b51a-b407e6e939e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:41.705069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-70202982-528e-4af6-b51a-b407e6e939e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:41.712368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-eb2a0ddd-132d-43c7-9efa-92d3fdf2624f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:41.726235 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-eb2a0ddd-132d-43c7-9efa-92d3fdf2624f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1318 microversion: 2.1 time: 0.212680 Aug 29 21:55:41.727619 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 373/752] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:41 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:41.923378 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-70202982-528e-4af6-b51a-b407e6e939e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:41.933133 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-70202982-528e-4af6-b51a-b407e6e939e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1724 microversion: 2.1 time: 0.256005 Aug 29 21:55:41.944891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 380/753] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:41 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:42.016047 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-dc50759c-a605-4a8b-80d7-f7a11b9064d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:42.016714 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-dc50759c-a605-4a8b-80d7-f7a11b9064d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:42.023042 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dc50759c-a605-4a8b-80d7-f7a11b9064d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:42.023537 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dc50759c-a605-4a8b-80d7-f7a11b9064d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:42.023974 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dc50759c-a605-4a8b-80d7-f7a11b9064d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:42.024733 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dc50759c-a605-4a8b-80d7-f7a11b9064d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:42.025194 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dc50759c-a605-4a8b-80d7-f7a11b9064d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:42.025667 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dc50759c-a605-4a8b-80d7-f7a11b9064d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:42.351973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-7a129e04-326b-4b29-b94d-a612692593d9 req-38faa2c4-a7c9-4cb1-973f-b027a0810158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315eda88-f51d-4b3a-8ff1-fdf6445d029c", "name": "network-vif-plugged", "status": "completed", "tag": "dffc19a7-1747-4f43-8267-b48210d30291"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:42.372094 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-7a129e04-326b-4b29-b94d-a612692593d9 req-38faa2c4-a7c9-4cb1-973f-b027a0810158 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:42.373166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-7a129e04-326b-4b29-b94d-a612692593d9 req-38faa2c4-a7c9-4cb1-973f-b027a0810158 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:42.374147 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-7a129e04-326b-4b29-b94d-a612692593d9 req-38faa2c4-a7c9-4cb1-973f-b027a0810158 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:42.399447 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-7a129e04-326b-4b29-b94d-a612692593d9 req-38faa2c4-a7c9-4cb1-973f-b027a0810158 service nova] Creating event network-vif-plugged:dffc19a7-1747-4f43-8267-b48210d30291 for instance 315eda88-f51d-4b3a-8ff1-fdf6445d029c on hv-cinder-85426 Aug 29 21:55:42.412251 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-7a129e04-326b-4b29-b94d-a612692593d9 req-38faa2c4-a7c9-4cb1-973f-b027a0810158 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065769 Aug 29 21:55:42.414072 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 381/754] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:55:42.554443 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-dc50759c-a605-4a8b-80d7-f7a11b9064d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:42.568327 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-dc50759c-a605-4a8b-80d7-f7a11b9064d8 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1361 microversion: 2.1 time: 0.556576 Aug 29 21:55:42.587009 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 374/755] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:42 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1361 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:42.750644 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-56cbe7a8-d301-4ac6-92c1-4b9de12dff57 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:42.752207 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-56cbe7a8-d301-4ac6-92c1-4b9de12dff57 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:42.761826 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-56cbe7a8-d301-4ac6-92c1-4b9de12dff57 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:42.762555 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-56cbe7a8-d301-4ac6-92c1-4b9de12dff57 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:42.763027 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-56cbe7a8-d301-4ac6-92c1-4b9de12dff57 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:42.763781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-56cbe7a8-d301-4ac6-92c1-4b9de12dff57 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:42.764947 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-56cbe7a8-d301-4ac6-92c1-4b9de12dff57 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:42.764947 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-56cbe7a8-d301-4ac6-92c1-4b9de12dff57 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:42.942362 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-56cbe7a8-d301-4ac6-92c1-4b9de12dff57 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:42.951662 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-56cbe7a8-d301-4ac6-92c1-4b9de12dff57 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1318 microversion: 2.1 time: 0.206931 Aug 29 21:55:42.952337 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 382/756] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:42 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:42.960187 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-317692b1-99c8-49a4-9311-ce51c11ca569 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:42.961681 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-317692b1-99c8-49a4-9311-ce51c11ca569 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:42.970313 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-317692b1-99c8-49a4-9311-ce51c11ca569 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:42.972981 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-317692b1-99c8-49a4-9311-ce51c11ca569 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:42.972981 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-317692b1-99c8-49a4-9311-ce51c11ca569 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:42.972981 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-317692b1-99c8-49a4-9311-ce51c11ca569 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:42.973318 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-317692b1-99c8-49a4-9311-ce51c11ca569 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:42.973743 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-317692b1-99c8-49a4-9311-ce51c11ca569 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:43.106027 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-73ef818b-e3e3-461d-90a5-56e12097fe03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-12098238"}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:43.107005 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-73ef818b-e3e3-461d-90a5-56e12097fe03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:43.116620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-73ef818b-e3e3-461d-90a5-56e12097fe03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:43.117264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-73ef818b-e3e3-461d-90a5-56e12097fe03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:43.117848 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-73ef818b-e3e3-461d-90a5-56e12097fe03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:43.118655 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-73ef818b-e3e3-461d-90a5-56e12097fe03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:43.119227 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-73ef818b-e3e3-461d-90a5-56e12097fe03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:43.119905 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-73ef818b-e3e3-461d-90a5-56e12097fe03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:43.136936 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-317692b1-99c8-49a4-9311-ce51c11ca569 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:43.147508 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-317692b1-99c8-49a4-9311-ce51c11ca569 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1724 microversion: 2.1 time: 0.192681 Aug 29 21:55:43.148322 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 375/757] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:42 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:43.290648 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.network.security_group_api [None req-73ef818b-e3e3-461d-90a5-56e12097fe03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Adding security group 5567bf31-3e0d-447c-b877-03fe64191627 to port b88a29b5-ab90-482e-8b10-2c1389ed5c8b Aug 29 21:55:43.597777 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8a363fba-b352-48fd-8c9c-92012f885d37 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:43.598481 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-8a363fba-b352-48fd-8c9c-92012f885d37 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:43.605741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a363fba-b352-48fd-8c9c-92012f885d37 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:43.606295 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a363fba-b352-48fd-8c9c-92012f885d37 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:43.606825 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a363fba-b352-48fd-8c9c-92012f885d37 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:43.607529 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a363fba-b352-48fd-8c9c-92012f885d37 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:43.607992 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a363fba-b352-48fd-8c9c-92012f885d37 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:43.608413 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a363fba-b352-48fd-8c9c-92012f885d37 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:43.755453 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-8a363fba-b352-48fd-8c9c-92012f885d37 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:43.764710 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-8a363fba-b352-48fd-8c9c-92012f885d37 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1361 microversion: 2.1 time: 0.172342 Aug 29 21:55:43.765372 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 376/758] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:43 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:43.799795 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-73ef818b-e3e3-461d-90a5-56e12097fe03 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "POST /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/action" status: 202 len: 0 microversion: 2.1 time: 0.702167 Aug 29 21:55:43.800636 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 383/759] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 21:55:43 2022] POST /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/action => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:55:43.809656 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-032be7f7-5f2d-41d8-8575-074877786fa6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:43.810354 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-032be7f7-5f2d-41d8-8575-074877786fa6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:43.814276 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-9a5a3c8a-f1a6-4b5b-9eaf-fb56b4405e69 req-77e41447-c018-4c58-b6f2-9d2001f8f5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9b91c1-cfde-4d81-ac00-b83f8b333df9", "tag": "b88a29b5-ab90-482e-8b10-2c1389ed5c8b"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:43.817457 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-032be7f7-5f2d-41d8-8575-074877786fa6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:43.817959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-032be7f7-5f2d-41d8-8575-074877786fa6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:43.818439 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-032be7f7-5f2d-41d8-8575-074877786fa6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:43.819723 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-032be7f7-5f2d-41d8-8575-074877786fa6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:43.820176 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-032be7f7-5f2d-41d8-8575-074877786fa6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:43.820637 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-032be7f7-5f2d-41d8-8575-074877786fa6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:43.833597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-9a5a3c8a-f1a6-4b5b-9eaf-fb56b4405e69 req-77e41447-c018-4c58-b6f2-9d2001f8f5d9 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:43.842104 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-9a5a3c8a-f1a6-4b5b-9eaf-fb56b4405e69 req-77e41447-c018-4c58-b6f2-9d2001f8f5d9 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:43.842104 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-9a5a3c8a-f1a6-4b5b-9eaf-fb56b4405e69 req-77e41447-c018-4c58-b6f2-9d2001f8f5d9 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:43.859991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-9a5a3c8a-f1a6-4b5b-9eaf-fb56b4405e69 req-77e41447-c018-4c58-b6f2-9d2001f8f5d9 service nova] Creating event network-changed:b88a29b5-ab90-482e-8b10-2c1389ed5c8b for instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 on hv-cinder-85426 Aug 29 21:55:43.870240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-9a5a3c8a-f1a6-4b5b-9eaf-fb56b4405e69 req-77e41447-c018-4c58-b6f2-9d2001f8f5d9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061266 Aug 29 21:55:43.876647 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 384/760] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:43.973511 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a0bcab7c-19bc-49c7-a510-a86e1ffc8786 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:43.974547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a0bcab7c-19bc-49c7-a510-a86e1ffc8786 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:43.985715 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a0bcab7c-19bc-49c7-a510-a86e1ffc8786 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:43.986549 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a0bcab7c-19bc-49c7-a510-a86e1ffc8786 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:43.987074 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a0bcab7c-19bc-49c7-a510-a86e1ffc8786 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:43.987903 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a0bcab7c-19bc-49c7-a510-a86e1ffc8786 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:43.989642 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a0bcab7c-19bc-49c7-a510-a86e1ffc8786 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:43.990313 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a0bcab7c-19bc-49c7-a510-a86e1ffc8786 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:44.029370 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-032be7f7-5f2d-41d8-8575-074877786fa6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:44.059565 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-032be7f7-5f2d-41d8-8575-074877786fa6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1758 microversion: 2.1 time: 0.253843 Aug 29 21:55:44.060618 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 377/761] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:43 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1758 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:44.166365 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a0bcab7c-19bc-49c7-a510-a86e1ffc8786 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:44.174832 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a0bcab7c-19bc-49c7-a510-a86e1ffc8786 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1318 microversion: 2.1 time: 0.205580 Aug 29 21:55:44.179238 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 385/762] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:43 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:44.182202 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b1e0042a-151c-4f29-bc00-72a7de055948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:44.182837 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b1e0042a-151c-4f29-bc00-72a7de055948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:44.189392 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b1e0042a-151c-4f29-bc00-72a7de055948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:44.189885 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b1e0042a-151c-4f29-bc00-72a7de055948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:44.190344 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b1e0042a-151c-4f29-bc00-72a7de055948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:44.191050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b1e0042a-151c-4f29-bc00-72a7de055948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:44.192001 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b1e0042a-151c-4f29-bc00-72a7de055948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:44.192664 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b1e0042a-151c-4f29-bc00-72a7de055948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:44.346185 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b1e0042a-151c-4f29-bc00-72a7de055948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:44.355262 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b1e0042a-151c-4f29-bc00-72a7de055948 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1730 microversion: 2.1 time: 0.177593 Aug 29 21:55:44.355854 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 378/763] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:44 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:44.381968 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-3d7c4ceb-ceb7-41e7-8413-4ca668bfd5d6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:44.388398 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3d7c4ceb-ceb7-41e7-8413-4ca668bfd5d6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:44.389700 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3d7c4ceb-ceb7-41e7-8413-4ca668bfd5d6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:44.390198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3d7c4ceb-ceb7-41e7-8413-4ca668bfd5d6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:44.390645 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3d7c4ceb-ceb7-41e7-8413-4ca668bfd5d6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:44.391361 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3d7c4ceb-ceb7-41e7-8413-4ca668bfd5d6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:44.391817 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3d7c4ceb-ceb7-41e7-8413-4ca668bfd5d6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:44.392243 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3d7c4ceb-ceb7-41e7-8413-4ca668bfd5d6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:44.432513 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-54a25e9d-3d7c-4599-b04f-4bfb1a96e402 req-2a2b27b3-1a5c-40bf-9fa2-e2c1c20b9bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aeae90c-192c-4d96-833e-2e4cdf0538f9", "name": "network-vif-plugged", "status": "completed", "tag": "4adb0541-9c38-4289-8fb7-313fc3bc11be"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:44.448251 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-54a25e9d-3d7c-4599-b04f-4bfb1a96e402 req-2a2b27b3-1a5c-40bf-9fa2-e2c1c20b9bc6 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:44.448913 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-54a25e9d-3d7c-4599-b04f-4bfb1a96e402 req-2a2b27b3-1a5c-40bf-9fa2-e2c1c20b9bc6 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:44.449465 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-54a25e9d-3d7c-4599-b04f-4bfb1a96e402 req-2a2b27b3-1a5c-40bf-9fa2-e2c1c20b9bc6 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:44.466453 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-54a25e9d-3d7c-4599-b04f-4bfb1a96e402 req-2a2b27b3-1a5c-40bf-9fa2-e2c1c20b9bc6 service nova] Creating event network-vif-plugged:4adb0541-9c38-4289-8fb7-313fc3bc11be for instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 on hv-cinder-85426 Aug 29 21:55:44.473693 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-54a25e9d-3d7c-4599-b04f-4bfb1a96e402 req-2a2b27b3-1a5c-40bf-9fa2-e2c1c20b9bc6 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047106 Aug 29 21:55:44.480102 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 379/764] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:44.510353 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-3d7c4ceb-ceb7-41e7-8413-4ca668bfd5d6 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132537 Aug 29 21:55:44.511274 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 386/765] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 21:55:44 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:44.794780 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8d2e412c-4703-49a8-bd48-752fa9eaea98 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:44.797941 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-8d2e412c-4703-49a8-bd48-752fa9eaea98 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:44.813535 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8d2e412c-4703-49a8-bd48-752fa9eaea98 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:44.814386 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8d2e412c-4703-49a8-bd48-752fa9eaea98 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:44.815392 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8d2e412c-4703-49a8-bd48-752fa9eaea98 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:44.817092 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8d2e412c-4703-49a8-bd48-752fa9eaea98 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:44.818589 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8d2e412c-4703-49a8-bd48-752fa9eaea98 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:44.840856 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8d2e412c-4703-49a8-bd48-752fa9eaea98 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:45.039024 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-8d2e412c-4703-49a8-bd48-752fa9eaea98 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:45.048188 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-8d2e412c-4703-49a8-bd48-752fa9eaea98 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1361 microversion: 2.1 time: 0.263219 Aug 29 21:55:45.048804 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 380/766] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:44 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1361 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:45.196693 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-cb34ce5d-8df7-4378-b923-05611af660dc tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:45.197327 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-cb34ce5d-8df7-4378-b923-05611af660dc tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:45.203890 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cb34ce5d-8df7-4378-b923-05611af660dc tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:45.205242 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cb34ce5d-8df7-4378-b923-05611af660dc tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:45.205242 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cb34ce5d-8df7-4378-b923-05611af660dc tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:45.205582 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cb34ce5d-8df7-4378-b923-05611af660dc tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:45.206030 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cb34ce5d-8df7-4378-b923-05611af660dc tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:45.206530 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cb34ce5d-8df7-4378-b923-05611af660dc tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:45.439049 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-cb34ce5d-8df7-4378-b923-05611af660dc tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:45.450978 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-cb34ce5d-8df7-4378-b923-05611af660dc tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1318 microversion: 2.1 time: 0.258768 Aug 29 21:55:45.451703 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 387/767] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:45 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:45.895506 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-32a7f66e-2208-4cea-8208-af0cd6222b66 req-c2358598-0716-467a-9cc1-26a9ee125622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "945580b2-8dd8-43c7-a485-9501fd158032", "tag": "caed18b7-a71c-45cd-90a8-5ac5f1382523"}, {"name": "network-changed", "server_uuid": "945580b2-8dd8-43c7-a485-9501fd158032", "tag": "caed18b7-a71c-45cd-90a8-5ac5f1382523"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:45.906717 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-32a7f66e-2208-4cea-8208-af0cd6222b66 req-c2358598-0716-467a-9cc1-26a9ee125622 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:45.907050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-32a7f66e-2208-4cea-8208-af0cd6222b66 req-c2358598-0716-467a-9cc1-26a9ee125622 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:45.907490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-32a7f66e-2208-4cea-8208-af0cd6222b66 req-c2358598-0716-467a-9cc1-26a9ee125622 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:45.920936 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-32a7f66e-2208-4cea-8208-af0cd6222b66 req-c2358598-0716-467a-9cc1-26a9ee125622 service nova] Creating event network-changed:caed18b7-a71c-45cd-90a8-5ac5f1382523 for instance 945580b2-8dd8-43c7-a485-9501fd158032 on hv-cinder-85426 Aug 29 21:55:45.921477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-32a7f66e-2208-4cea-8208-af0cd6222b66 req-c2358598-0716-467a-9cc1-26a9ee125622 service nova] Creating event network-changed:caed18b7-a71c-45cd-90a8-5ac5f1382523 for instance 945580b2-8dd8-43c7-a485-9501fd158032 on hv-cinder-85426 Aug 29 21:55:45.927065 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-32a7f66e-2208-4cea-8208-af0cd6222b66 req-c2358598-0716-467a-9cc1-26a9ee125622 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035481 Aug 29 21:55:45.927676 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 381/768] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:46.071028 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9c4db89d-6c79-4700-9ae4-0e5c0e478c2a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:46.071809 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9c4db89d-6c79-4700-9ae4-0e5c0e478c2a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:46.078584 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9c4db89d-6c79-4700-9ae4-0e5c0e478c2a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:46.079114 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9c4db89d-6c79-4700-9ae4-0e5c0e478c2a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:46.079641 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9c4db89d-6c79-4700-9ae4-0e5c0e478c2a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:46.080371 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9c4db89d-6c79-4700-9ae4-0e5c0e478c2a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:46.080866 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9c4db89d-6c79-4700-9ae4-0e5c0e478c2a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:46.081299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9c4db89d-6c79-4700-9ae4-0e5c0e478c2a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:46.262416 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9c4db89d-6c79-4700-9ae4-0e5c0e478c2a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:46.271698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9c4db89d-6c79-4700-9ae4-0e5c0e478c2a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1361 microversion: 2.1 time: 0.204744 Aug 29 21:55:46.273188 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 388/769] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:46 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:46.474237 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ea1db308-6f9d-4634-9e1d-4f739bcc913f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:46.475528 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ea1db308-6f9d-4634-9e1d-4f739bcc913f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:46.483001 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ea1db308-6f9d-4634-9e1d-4f739bcc913f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:46.483604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ea1db308-6f9d-4634-9e1d-4f739bcc913f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:46.484195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ea1db308-6f9d-4634-9e1d-4f739bcc913f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:46.485157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ea1db308-6f9d-4634-9e1d-4f739bcc913f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:46.485752 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ea1db308-6f9d-4634-9e1d-4f739bcc913f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:46.486278 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ea1db308-6f9d-4634-9e1d-4f739bcc913f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:46.829201 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ea1db308-6f9d-4634-9e1d-4f739bcc913f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:46.844215 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ea1db308-6f9d-4634-9e1d-4f739bcc913f tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1506 microversion: 2.1 time: 0.374126 Aug 29 21:55:46.845848 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 382/770] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:46 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:55:46.873765 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2df4ad08-9566-4151-a3b7-f1fce2dce977 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7b354d3-caf4-4307-834f-f730ff001c6a", "device": "/dev/sdb"}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:46.879853 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2df4ad08-9566-4151-a3b7-f1fce2dce977 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:46.892377 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2df4ad08-9566-4151-a3b7-f1fce2dce977 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:46.893627 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2df4ad08-9566-4151-a3b7-f1fce2dce977 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:46.894653 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2df4ad08-9566-4151-a3b7-f1fce2dce977 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:46.896433 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2df4ad08-9566-4151-a3b7-f1fce2dce977 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:46.898190 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2df4ad08-9566-4151-a3b7-f1fce2dce977 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:46.899203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2df4ad08-9566-4151-a3b7-f1fce2dce977 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:47.307117 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4e3d62f7-22e5-4c33-8449-c5a46308fbf0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:47.307916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4e3d62f7-22e5-4c33-8449-c5a46308fbf0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:47.315664 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e3d62f7-22e5-4c33-8449-c5a46308fbf0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:47.316262 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e3d62f7-22e5-4c33-8449-c5a46308fbf0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:47.316766 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e3d62f7-22e5-4c33-8449-c5a46308fbf0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:47.317560 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e3d62f7-22e5-4c33-8449-c5a46308fbf0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:47.318037 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e3d62f7-22e5-4c33-8449-c5a46308fbf0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:47.318469 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e3d62f7-22e5-4c33-8449-c5a46308fbf0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:47.469380 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4e3d62f7-22e5-4c33-8449-c5a46308fbf0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:47.477583 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4e3d62f7-22e5-4c33-8449-c5a46308fbf0 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1361 microversion: 2.1 time: 0.174919 Aug 29 21:55:47.478174 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 383/771] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:47 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:48.499251 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b3455390-eac0-4e14-8572-3d8a68924334 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:48.500138 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b3455390-eac0-4e14-8572-3d8a68924334 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:48.508154 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b3455390-eac0-4e14-8572-3d8a68924334 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:48.508763 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b3455390-eac0-4e14-8572-3d8a68924334 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:48.509330 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b3455390-eac0-4e14-8572-3d8a68924334 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:48.510114 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b3455390-eac0-4e14-8572-3d8a68924334 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:48.510594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b3455390-eac0-4e14-8572-3d8a68924334 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:48.511054 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b3455390-eac0-4e14-8572-3d8a68924334 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:48.666460 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2df4ad08-9566-4151-a3b7-f1fce2dce977 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "POST /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.797055 Aug 29 21:55:48.673910 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 389/772] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 21:55:46 2022] POST /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c/os-volume_attachments => generated 194 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:55:48.793345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b3455390-eac0-4e14-8572-3d8a68924334 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:55:48.802747 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b3455390-eac0-4e14-8572-3d8a68924334 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1548 microversion: 2.1 time: 0.307991 Aug 29 21:55:48.803406 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 384/773] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:55:48 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1548 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:55:48.826696 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2f1a79d7-9f82-4eca-9f24-017c69e1a69e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:55:48.827282 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2f1a79d7-9f82-4eca-9f24-017c69e1a69e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:55:48.833695 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2f1a79d7-9f82-4eca-9f24-017c69e1a69e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:48.834189 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2f1a79d7-9f82-4eca-9f24-017c69e1a69e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:48.835202 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2f1a79d7-9f82-4eca-9f24-017c69e1a69e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:48.835914 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2f1a79d7-9f82-4eca-9f24-017c69e1a69e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:48.836381 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2f1a79d7-9f82-4eca-9f24-017c69e1a69e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:48.836845 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2f1a79d7-9f82-4eca-9f24-017c69e1a69e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:48.932230 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2f1a79d7-9f82-4eca-9f24-017c69e1a69e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109634 Aug 29 21:55:48.933877 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 390/774] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 21:55:48 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:50.408657 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-ed5e9597-04e4-4d11-80d2-4aa9fdeeee5e req-5a820528-ee1d-4b52-8cd6-2bf3bdfd97ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aeae90c-192c-4d96-833e-2e4cdf0538f9", "tag": "4adb0541-9c38-4289-8fb7-313fc3bc11be"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:50.419933 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-ed5e9597-04e4-4d11-80d2-4aa9fdeeee5e req-5a820528-ee1d-4b52-8cd6-2bf3bdfd97ab service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:50.420408 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-ed5e9597-04e4-4d11-80d2-4aa9fdeeee5e req-5a820528-ee1d-4b52-8cd6-2bf3bdfd97ab service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:50.421068 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-ed5e9597-04e4-4d11-80d2-4aa9fdeeee5e req-5a820528-ee1d-4b52-8cd6-2bf3bdfd97ab service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:50.433856 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-ed5e9597-04e4-4d11-80d2-4aa9fdeeee5e req-5a820528-ee1d-4b52-8cd6-2bf3bdfd97ab service nova] Creating event network-changed:4adb0541-9c38-4289-8fb7-313fc3bc11be for instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 on hv-cinder-85426 Aug 29 21:55:50.447160 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-ed5e9597-04e4-4d11-80d2-4aa9fdeeee5e req-5a820528-ee1d-4b52-8cd6-2bf3bdfd97ab service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034364 Aug 29 21:55:50.447160 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 385/775] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:55:53.347203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-a444e9c7-667d-4673-b960-dfa45cff34f3 req-bcaef9af-10d6-43f0-bd8f-fa2db4404207 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "e7b354d3-caf4-4307-834f-f730ff001c6a", "create_info": {"type": "qcow2", "new_file": "volume-e7b354d3-caf4-4307-834f-f730ff001c6a.fceed7ef-ae9a-4e9f-86e6-2b4fbed33652.vhdx", "snapshot_id": "fceed7ef-ae9a-4e9f-86e6-2b4fbed33652"}}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:53.350907 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-a444e9c7-667d-4673-b960-dfa45cff34f3 req-bcaef9af-10d6-43f0-bd8f-fa2db4404207 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:53.351397 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-a444e9c7-667d-4673-b960-dfa45cff34f3 req-bcaef9af-10d6-43f0-bd8f-fa2db4404207 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:53.351837 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-a444e9c7-667d-4673-b960-dfa45cff34f3 req-bcaef9af-10d6-43f0-bd8f-fa2db4404207 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:53.360974 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-a444e9c7-667d-4673-b960-dfa45cff34f3 req-bcaef9af-10d6-43f0-bd8f-fa2db4404207 admin admin] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:53.361603 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-a444e9c7-667d-4673-b960-dfa45cff34f3 req-bcaef9af-10d6-43f0-bd8f-fa2db4404207 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:53.362157 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-a444e9c7-667d-4673-b960-dfa45cff34f3 req-bcaef9af-10d6-43f0-bd8f-fa2db4404207 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:53.378043 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-a444e9c7-667d-4673-b960-dfa45cff34f3 req-bcaef9af-10d6-43f0-bd8f-fa2db4404207 admin admin] 10.222.0.121 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.164103 Aug 29 21:55:53.378965 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 391/776] 10.222.0.121 () {64 vars in 1327 bytes} [Mon Aug 29 21:55:53 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:55:59.045348 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-da86f14e-412a-48f3-b19b-71cf70e4c18a req-79832b1e-d2bf-4ecb-a482-21662b85c1ab admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "e7b354d3-caf4-4307-834f-f730ff001c6a", "create_info": {"type": "qcow2", "new_file": "volume-e7b354d3-caf4-4307-834f-f730ff001c6a.7ab1e5a5-fffb-49e2-bd61-d194cecfdede.vhdx", "snapshot_id": "7ab1e5a5-fffb-49e2-bd61-d194cecfdede"}}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:55:59.048954 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-da86f14e-412a-48f3-b19b-71cf70e4c18a req-79832b1e-d2bf-4ecb-a482-21662b85c1ab admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:59.049439 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-da86f14e-412a-48f3-b19b-71cf70e4c18a req-79832b1e-d2bf-4ecb-a482-21662b85c1ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:59.049870 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-da86f14e-412a-48f3-b19b-71cf70e4c18a req-79832b1e-d2bf-4ecb-a482-21662b85c1ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:59.058823 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-da86f14e-412a-48f3-b19b-71cf70e4c18a req-79832b1e-d2bf-4ecb-a482-21662b85c1ab admin admin] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:55:59.066352 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-da86f14e-412a-48f3-b19b-71cf70e4c18a req-79832b1e-d2bf-4ecb-a482-21662b85c1ab admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:55:59.066352 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-da86f14e-412a-48f3-b19b-71cf70e4c18a req-79832b1e-d2bf-4ecb-a482-21662b85c1ab admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:55:59.072892 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-da86f14e-412a-48f3-b19b-71cf70e4c18a req-79832b1e-d2bf-4ecb-a482-21662b85c1ab admin admin] 10.222.0.121 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.106379 Aug 29 21:55:59.073571 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 386/777] 10.222.0.121 () {64 vars in 1327 bytes} [Mon Aug 29 21:55:58 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:56:03.728223 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:03.729236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=2 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:03.729886 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:03.781706 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-2048fcdc-dce6-45b0-8847-cd853b3586fa req-6c8e9f5c-1a08-49d8-84ce-77e2838fc462 admin admin] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:03.784977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-2048fcdc-dce6-45b0-8847-cd853b3586fa req-6c8e9f5c-1a08-49d8-84ce-77e2838fc462 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:03.785469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-2048fcdc-dce6-45b0-8847-cd853b3586fa req-6c8e9f5c-1a08-49d8-84ce-77e2838fc462 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:03.785907 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-2048fcdc-dce6-45b0-8847-cd853b3586fa req-6c8e9f5c-1a08-49d8-84ce-77e2838fc462 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:03.796278 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-2048fcdc-dce6-45b0-8847-cd853b3586fa req-6c8e9f5c-1a08-49d8-84ce-77e2838fc462 admin admin] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:03.796793 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-2048fcdc-dce6-45b0-8847-cd853b3586fa req-6c8e9f5c-1a08-49d8-84ce-77e2838fc462 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:03.797231 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-2048fcdc-dce6-45b0-8847-cd853b3586fa req-6c8e9f5c-1a08-49d8-84ce-77e2838fc462 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:03.813809 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-2048fcdc-dce6-45b0-8847-cd853b3586fa req-6c8e9f5c-1a08-49d8-84ce-77e2838fc462 admin admin] 10.222.0.121 "DELETE /compute/v2.1/os-assisted-volume-snapshots/7ab1e5a5-fffb-49e2-bd61-d194cecfdede?delete_info=%7B%22file_to_merge%22:%20%22volume-e7b354d3-caf4-4307-834f-f730ff001c6a.7ab1e5a5-fffb-49e2-bd61-d194cecfdede.vhdx%22,%20%22volume_id%22:%20%22e7b354d3-caf4-4307-834f-f730ff001c6a%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.087187 Aug 29 21:56:03.814392 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 392/778] 10.222.0.121 () {62 vars in 1801 bytes} [Mon Aug 29 21:56:03 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/7ab1e5a5-fffb-49e2-bd61-d194cecfdede?delete_info=%7B%22file_to_merge%22:%20%22volume-e7b354d3-caf4-4307-834f-f730ff001c6a.7ab1e5a5-fffb-49e2-bd61-d194cecfdede.vhdx%22,%20%22volume_id%22:%20%22e7b354d3-caf4-4307-834f-f730ff001c6a%22%7D => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:56:07.972247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=57 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:08.033667 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-b40797bd-9319-48fd-8f63-62efb1697ed9 req-0ad1ca06-f8cf-4003-8729-2895c8373ab6 admin admin] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:08.036953 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-b40797bd-9319-48fd-8f63-62efb1697ed9 req-0ad1ca06-f8cf-4003-8729-2895c8373ab6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:08.037930 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-b40797bd-9319-48fd-8f63-62efb1697ed9 req-0ad1ca06-f8cf-4003-8729-2895c8373ab6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:08.038359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-b40797bd-9319-48fd-8f63-62efb1697ed9 req-0ad1ca06-f8cf-4003-8729-2895c8373ab6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:08.047883 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-b40797bd-9319-48fd-8f63-62efb1697ed9 req-0ad1ca06-f8cf-4003-8729-2895c8373ab6 admin admin] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:08.048368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-b40797bd-9319-48fd-8f63-62efb1697ed9 req-0ad1ca06-f8cf-4003-8729-2895c8373ab6 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:08.048823 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-b40797bd-9319-48fd-8f63-62efb1697ed9 req-0ad1ca06-f8cf-4003-8729-2895c8373ab6 admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:08.063167 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-b40797bd-9319-48fd-8f63-62efb1697ed9 req-0ad1ca06-f8cf-4003-8729-2895c8373ab6 admin admin] 10.222.0.121 "DELETE /compute/v2.1/os-assisted-volume-snapshots/6c20f129-7b5b-4c6d-9650-cf0293497515?delete_info=%7B%22file_to_merge%22:%20%22volume-e7b354d3-caf4-4307-834f-f730ff001c6a.6c20f129-7b5b-4c6d-9650-cf0293497515.vhdx%22,%20%22volume_id%22:%20%22e7b354d3-caf4-4307-834f-f730ff001c6a%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.092057 Aug 29 21:56:08.063756 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 387/779] 10.222.0.121 () {62 vars in 1801 bytes} [Mon Aug 29 21:56:07 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/6c20f129-7b5b-4c6d-9650-cf0293497515?delete_info=%7B%22file_to_merge%22:%20%22volume-e7b354d3-caf4-4307-834f-f730ff001c6a.6c20f129-7b5b-4c6d-9650-cf0293497515.vhdx%22,%20%22volume_id%22:%20%22e7b354d3-caf4-4307-834f-f730ff001c6a%22%7D => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:56:12.312645 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-bd2ca11a-324b-4c35-8048-3806d2445bfe req-a94baf28-e8d0-45af-abd1-fa26b3a057ad admin admin] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:12.316053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-bd2ca11a-324b-4c35-8048-3806d2445bfe req-a94baf28-e8d0-45af-abd1-fa26b3a057ad admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:12.316576 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-bd2ca11a-324b-4c35-8048-3806d2445bfe req-a94baf28-e8d0-45af-abd1-fa26b3a057ad admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:12.317022 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-bd2ca11a-324b-4c35-8048-3806d2445bfe req-a94baf28-e8d0-45af-abd1-fa26b3a057ad admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:12.325972 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-bd2ca11a-324b-4c35-8048-3806d2445bfe req-a94baf28-e8d0-45af-abd1-fa26b3a057ad admin admin] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:12.326462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-bd2ca11a-324b-4c35-8048-3806d2445bfe req-a94baf28-e8d0-45af-abd1-fa26b3a057ad admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:12.327132 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-bd2ca11a-324b-4c35-8048-3806d2445bfe req-a94baf28-e8d0-45af-abd1-fa26b3a057ad admin admin] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:12.346352 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-bd2ca11a-324b-4c35-8048-3806d2445bfe req-a94baf28-e8d0-45af-abd1-fa26b3a057ad admin admin] 10.222.0.121 "DELETE /compute/v2.1/os-assisted-volume-snapshots/fceed7ef-ae9a-4e9f-86e6-2b4fbed33652?delete_info=%7B%22file_to_merge%22:%20%22volume-e7b354d3-caf4-4307-834f-f730ff001c6a.fceed7ef-ae9a-4e9f-86e6-2b4fbed33652.vhdx%22,%20%22volume_id%22:%20%22e7b354d3-caf4-4307-834f-f730ff001c6a%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.088204 Aug 29 21:56:12.347206 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 393/780] 10.222.0.121 () {62 vars in 1801 bytes} [Mon Aug 29 21:56:12 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/fceed7ef-ae9a-4e9f-86e6-2b4fbed33652?delete_info=%7B%22file_to_merge%22:%20%22volume-e7b354d3-caf4-4307-834f-f730ff001c6a.fceed7ef-ae9a-4e9f-86e6-2b4fbed33652.vhdx%22,%20%22volume_id%22:%20%22e7b354d3-caf4-4307-834f-f730ff001c6a%22%7D => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:56:14.469653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7e2594f2-b309-45c5-b54c-6a0774c3f121 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:56:14.471874 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7e2594f2-b309-45c5-b54c-6a0774c3f121 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:14.481792 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7e2594f2-b309-45c5-b54c-6a0774c3f121 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:14.482279 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7e2594f2-b309-45c5-b54c-6a0774c3f121 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:14.482724 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7e2594f2-b309-45c5-b54c-6a0774c3f121 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:14.483425 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7e2594f2-b309-45c5-b54c-6a0774c3f121 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:14.483881 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7e2594f2-b309-45c5-b54c-6a0774c3f121 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:14.484371 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7e2594f2-b309-45c5-b54c-6a0774c3f121 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:14.487478 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=95 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:14.771340 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7e2594f2-b309-45c5-b54c-6a0774c3f121 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "POST /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/action" status: 202 len: 0 microversion: 2.1 time: 0.306554 Aug 29 21:56:14.782023 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 388/781] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 21:56:14 2022] POST /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:56:14.782193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-554f3c23-72b6-4ee9-bf34-e9ed523c6277 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:14.782851 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-554f3c23-72b6-4ee9-bf34-e9ed523c6277 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:14.789905 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-554f3c23-72b6-4ee9-bf34-e9ed523c6277 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:14.790239 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-554f3c23-72b6-4ee9-bf34-e9ed523c6277 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:14.790687 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-554f3c23-72b6-4ee9-bf34-e9ed523c6277 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:14.791405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-554f3c23-72b6-4ee9-bf34-e9ed523c6277 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:14.791896 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-554f3c23-72b6-4ee9-bf34-e9ed523c6277 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:14.792343 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-554f3c23-72b6-4ee9-bf34-e9ed523c6277 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:14.978370 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-554f3c23-72b6-4ee9-bf34-e9ed523c6277 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:14.991111 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-554f3c23-72b6-4ee9-bf34-e9ed523c6277 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1750 microversion: 2.1 time: 0.213261 Aug 29 21:56:14.991719 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 394/782] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:14 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1750 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:16.017024 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-791e6e71-b6ab-45c9-805e-df3bfc389bfd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:16.023978 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-791e6e71-b6ab-45c9-805e-df3bfc389bfd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:16.025316 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-791e6e71-b6ab-45c9-805e-df3bfc389bfd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:16.025818 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-791e6e71-b6ab-45c9-805e-df3bfc389bfd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:16.026291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-791e6e71-b6ab-45c9-805e-df3bfc389bfd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:16.026971 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-791e6e71-b6ab-45c9-805e-df3bfc389bfd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:16.027421 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-791e6e71-b6ab-45c9-805e-df3bfc389bfd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:16.027847 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-791e6e71-b6ab-45c9-805e-df3bfc389bfd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:16.189909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-791e6e71-b6ab-45c9-805e-df3bfc389bfd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:16.198895 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-791e6e71-b6ab-45c9-805e-df3bfc389bfd tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1755 microversion: 2.1 time: 0.186001 Aug 29 21:56:16.199475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 389/783] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:16 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:16.305855 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-64baa82b-6818-4b87-bcb8-635f60daaf61 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:16.306656 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-64baa82b-6818-4b87-bcb8-635f60daaf61 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:16.318543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-64baa82b-6818-4b87-bcb8-635f60daaf61 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:16.319467 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-64baa82b-6818-4b87-bcb8-635f60daaf61 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:16.320142 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-64baa82b-6818-4b87-bcb8-635f60daaf61 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:16.320950 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-64baa82b-6818-4b87-bcb8-635f60daaf61 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:16.321589 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-64baa82b-6818-4b87-bcb8-635f60daaf61 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:16.322174 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-64baa82b-6818-4b87-bcb8-635f60daaf61 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:16.430523 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-64baa82b-6818-4b87-bcb8-635f60daaf61 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lazy-loading 'services' on Instance uuid 315eda88-f51d-4b3a-8ff1-fdf6445d029c {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:56:16.628934 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-528734b8-fdbc-4124-bddf-bbc6798acc8c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:16.629437 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-528734b8-fdbc-4124-bddf-bbc6798acc8c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:16.636114 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-528734b8-fdbc-4124-bddf-bbc6798acc8c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:16.636638 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-528734b8-fdbc-4124-bddf-bbc6798acc8c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:16.637102 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-528734b8-fdbc-4124-bddf-bbc6798acc8c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:16.637821 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-528734b8-fdbc-4124-bddf-bbc6798acc8c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:16.638277 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-528734b8-fdbc-4124-bddf-bbc6798acc8c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:16.638716 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-528734b8-fdbc-4124-bddf-bbc6798acc8c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:16.666781 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-528734b8-fdbc-4124-bddf-bbc6798acc8c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620/ips" status: 200 len: 152 microversion: 2.20 time: 0.159596 Aug 29 21:56:16.667475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 390/784] 10.222.0.83 () {60 vars in 1289 bytes} [Mon Aug 29 21:56:16 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620/ips => generated 152 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 21:56:16.735002 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-64baa82b-6818-4b87-bcb8-635f60daaf61 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "DELETE /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c/os-volume_attachments/e7b354d3-caf4-4307-834f-f730ff001c6a" status: 202 len: 0 microversion: 2.1 time: 0.434277 Aug 29 21:56:16.736735 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 395/785] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 21:56:16 2022] DELETE /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c/os-volume_attachments/e7b354d3-caf4-4307-834f-f730ff001c6a => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:56:17.221810 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-5f330e71-03e2-4f73-adb7-59f68f5aa193 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:17.222832 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-5f330e71-03e2-4f73-adb7-59f68f5aa193 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:17.230791 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5f330e71-03e2-4f73-adb7-59f68f5aa193 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:17.231278 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5f330e71-03e2-4f73-adb7-59f68f5aa193 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:17.231725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5f330e71-03e2-4f73-adb7-59f68f5aa193 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:17.232429 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5f330e71-03e2-4f73-adb7-59f68f5aa193 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:17.233062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5f330e71-03e2-4f73-adb7-59f68f5aa193 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:17.233490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5f330e71-03e2-4f73-adb7-59f68f5aa193 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:17.436514 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-5f330e71-03e2-4f73-adb7-59f68f5aa193 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:17.450638 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-5f330e71-03e2-4f73-adb7-59f68f5aa193 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1755 microversion: 2.1 time: 0.233152 Aug 29 21:56:17.451427 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 391/786] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:17 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1755 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:18.484073 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-16cc919e-d335-4bd5-a3d8-42c71fafceea tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:18.485025 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-16cc919e-d335-4bd5-a3d8-42c71fafceea tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:18.491668 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-16cc919e-d335-4bd5-a3d8-42c71fafceea tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:18.492152 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-16cc919e-d335-4bd5-a3d8-42c71fafceea tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:18.492632 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-16cc919e-d335-4bd5-a3d8-42c71fafceea tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:18.493337 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-16cc919e-d335-4bd5-a3d8-42c71fafceea tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:18.493785 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-16cc919e-d335-4bd5-a3d8-42c71fafceea tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:18.494213 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-16cc919e-d335-4bd5-a3d8-42c71fafceea tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:18.680573 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-16cc919e-d335-4bd5-a3d8-42c71fafceea tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:18.695351 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-16cc919e-d335-4bd5-a3d8-42c71fafceea tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1755 microversion: 2.1 time: 0.215862 Aug 29 21:56:18.695957 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 396/787] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:18 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1755 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:18.951741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-fc96690e-ff2d-4eae-b371-6d609b685905 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:18.952466 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-fc96690e-ff2d-4eae-b371-6d609b685905 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:18.954771 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=4 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:18.960826 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fc96690e-ff2d-4eae-b371-6d609b685905 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:18.961379 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fc96690e-ff2d-4eae-b371-6d609b685905 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:18.961923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fc96690e-ff2d-4eae-b371-6d609b685905 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:18.962696 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fc96690e-ff2d-4eae-b371-6d609b685905 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:18.963283 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fc96690e-ff2d-4eae-b371-6d609b685905 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:18.963757 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fc96690e-ff2d-4eae-b371-6d609b685905 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:19.011647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-fc96690e-ff2d-4eae-b371-6d609b685905 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Going to try to terminate instance {{(pid=127883) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:56:19.390261 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-fc96690e-ff2d-4eae-b371-6d609b685905 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "DELETE /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 204 len: 0 microversion: 2.1 time: 0.442644 Aug 29 21:56:19.390950 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 392/788] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:56:18 2022] DELETE /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:56:19.401292 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ad809b22-bbcd-42df-b716-d497c67b8d09 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:19.402011 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ad809b22-bbcd-42df-b716-d497c67b8d09 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:19.409091 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ad809b22-bbcd-42df-b716-d497c67b8d09 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:19.416126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ad809b22-bbcd-42df-b716-d497c67b8d09 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:19.416126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ad809b22-bbcd-42df-b716-d497c67b8d09 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:19.416126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ad809b22-bbcd-42df-b716-d497c67b8d09 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:19.416126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ad809b22-bbcd-42df-b716-d497c67b8d09 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:19.416943 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ad809b22-bbcd-42df-b716-d497c67b8d09 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:19.581185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ad809b22-bbcd-42df-b716-d497c67b8d09 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:19.589691 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ad809b22-bbcd-42df-b716-d497c67b8d09 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1512 microversion: 2.1 time: 0.193685 Aug 29 21:56:19.590348 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 397/789] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:19 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1512 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:56:19.726731 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f0639ca1-a540-421d-a48c-9c910fe1b3d2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:19.727334 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f0639ca1-a540-421d-a48c-9c910fe1b3d2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:19.733923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f0639ca1-a540-421d-a48c-9c910fe1b3d2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:19.734422 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f0639ca1-a540-421d-a48c-9c910fe1b3d2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:19.734865 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f0639ca1-a540-421d-a48c-9c910fe1b3d2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:19.735585 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f0639ca1-a540-421d-a48c-9c910fe1b3d2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:19.736054 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f0639ca1-a540-421d-a48c-9c910fe1b3d2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:19.736513 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f0639ca1-a540-421d-a48c-9c910fe1b3d2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:19.906586 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f0639ca1-a540-421d-a48c-9c910fe1b3d2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:19.920564 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f0639ca1-a540-421d-a48c-9c910fe1b3d2 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1755 microversion: 2.1 time: 0.198068 Aug 29 21:56:19.921104 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 393/790] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:19 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:20.449255 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-8d9687bc-43c1-4ae4-aae1-c326ff1bc9fc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:56:20.450211 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-8d9687bc-43c1-4ae4-aae1-c326ff1bc9fc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:20.460978 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8d9687bc-43c1-4ae4-aae1-c326ff1bc9fc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:20.461846 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8d9687bc-43c1-4ae4-aae1-c326ff1bc9fc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:20.462619 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8d9687bc-43c1-4ae4-aae1-c326ff1bc9fc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:20.463872 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8d9687bc-43c1-4ae4-aae1-c326ff1bc9fc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:20.464701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8d9687bc-43c1-4ae4-aae1-c326ff1bc9fc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:20.465467 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8d9687bc-43c1-4ae4-aae1-c326ff1bc9fc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:20.503433 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-8d9687bc-43c1-4ae4-aae1-c326ff1bc9fc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lazy-loading 'flavor' on Instance uuid d01db998-129a-4b44-a3c4-1da1bf023620 {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:56:20.615045 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7f1db76d-f39a-456a-876d-75d120661557 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:20.616755 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7f1db76d-f39a-456a-876d-75d120661557 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:20.628192 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7f1db76d-f39a-456a-876d-75d120661557 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:20.629024 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7f1db76d-f39a-456a-876d-75d120661557 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:20.629728 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7f1db76d-f39a-456a-876d-75d120661557 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:20.630915 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7f1db76d-f39a-456a-876d-75d120661557 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:20.632208 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7f1db76d-f39a-456a-876d-75d120661557 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:20.633086 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7f1db76d-f39a-456a-876d-75d120661557 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:20.795360 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7f1db76d-f39a-456a-876d-75d120661557 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:20.804768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7f1db76d-f39a-456a-876d-75d120661557 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1512 microversion: 2.1 time: 0.196121 Aug 29 21:56:20.805368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 394/791] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:20 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:20.943702 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-c0089147-d4d3-4655-b1f5-dc5879f104ba tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:20.944738 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-c0089147-d4d3-4655-b1f5-dc5879f104ba tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:20.951223 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c0089147-d4d3-4655-b1f5-dc5879f104ba tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:20.960744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c0089147-d4d3-4655-b1f5-dc5879f104ba tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:20.960744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c0089147-d4d3-4655-b1f5-dc5879f104ba tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:20.960744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c0089147-d4d3-4655-b1f5-dc5879f104ba tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:20.960744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c0089147-d4d3-4655-b1f5-dc5879f104ba tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:20.961407 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c0089147-d4d3-4655-b1f5-dc5879f104ba tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:21.074664 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-8d9687bc-43c1-4ae4-aae1-c326ff1bc9fc tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "POST /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620/action" status: 202 len: 0 microversion: 2.20 time: 0.633243 Aug 29 21:56:21.075687 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 398/792] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 21:56:20 2022] POST /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620/action => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:56:21.086444 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d7b1dd0e-fc72-4f4d-9ab8-3fc18b651e7e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:21.087153 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d7b1dd0e-fc72-4f4d-9ab8-3fc18b651e7e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:21.094126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d7b1dd0e-fc72-4f4d-9ab8-3fc18b651e7e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:21.094626 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d7b1dd0e-fc72-4f4d-9ab8-3fc18b651e7e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:21.095068 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d7b1dd0e-fc72-4f4d-9ab8-3fc18b651e7e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:21.095918 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d7b1dd0e-fc72-4f4d-9ab8-3fc18b651e7e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:21.096538 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d7b1dd0e-fc72-4f4d-9ab8-3fc18b651e7e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:21.097149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d7b1dd0e-fc72-4f4d-9ab8-3fc18b651e7e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:21.138340 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-c0089147-d4d3-4655-b1f5-dc5879f104ba tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:21.146254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-c0089147-d4d3-4655-b1f5-dc5879f104ba tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1755 microversion: 2.1 time: 0.207553 Aug 29 21:56:21.147425 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 395/793] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:20 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1755 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:56:21.291940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d7b1dd0e-fc72-4f4d-9ab8-3fc18b651e7e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:21.301170 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d7b1dd0e-fc72-4f4d-9ab8-3fc18b651e7e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:21.302691 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d7b1dd0e-fc72-4f4d-9ab8-3fc18b651e7e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:21.304052 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d7b1dd0e-fc72-4f4d-9ab8-3fc18b651e7e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.222781 Aug 29 21:56:21.304717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 399/794] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:21 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:21.826881 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8e4c7a8c-19b4-466c-810d-f30519d3cc79 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:21.827474 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-8e4c7a8c-19b4-466c-810d-f30519d3cc79 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:21.834853 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e4c7a8c-19b4-466c-810d-f30519d3cc79 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:21.835339 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e4c7a8c-19b4-466c-810d-f30519d3cc79 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:21.835772 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e4c7a8c-19b4-466c-810d-f30519d3cc79 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:21.836536 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e4c7a8c-19b4-466c-810d-f30519d3cc79 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:21.836955 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e4c7a8c-19b4-466c-810d-f30519d3cc79 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:21.837376 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e4c7a8c-19b4-466c-810d-f30519d3cc79 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:21.991635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-8e4c7a8c-19b4-466c-810d-f30519d3cc79 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:21.999642 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-8e4c7a8c-19b4-466c-810d-f30519d3cc79 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1512 microversion: 2.1 time: 0.176551 Aug 29 21:56:22.000228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 396/795] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:21 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:22.173228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6b379759-824e-45b9-8d0e-040e98bdb703 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:22.174345 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-6b379759-824e-45b9-8d0e-040e98bdb703 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:22.184524 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6b379759-824e-45b9-8d0e-040e98bdb703 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:22.185021 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6b379759-824e-45b9-8d0e-040e98bdb703 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:22.185462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6b379759-824e-45b9-8d0e-040e98bdb703 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:22.186185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6b379759-824e-45b9-8d0e-040e98bdb703 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:22.186643 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6b379759-824e-45b9-8d0e-040e98bdb703 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:22.187073 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6b379759-824e-45b9-8d0e-040e98bdb703 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:22.323305 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=4 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:22.329085 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-febdfe2d-bb52-4d75-9185-6ae24420ab87 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:22.336607 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-febdfe2d-bb52-4d75-9185-6ae24420ab87 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:22.336787 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-febdfe2d-bb52-4d75-9185-6ae24420ab87 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:22.337271 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-febdfe2d-bb52-4d75-9185-6ae24420ab87 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:22.337703 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-febdfe2d-bb52-4d75-9185-6ae24420ab87 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:22.338402 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-febdfe2d-bb52-4d75-9185-6ae24420ab87 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:22.338849 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-febdfe2d-bb52-4d75-9185-6ae24420ab87 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:22.339270 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-febdfe2d-bb52-4d75-9185-6ae24420ab87 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:22.430510 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-6b379759-824e-45b9-8d0e-040e98bdb703 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:22.443209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-6b379759-824e-45b9-8d0e-040e98bdb703 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1755 microversion: 2.1 time: 0.277613 Aug 29 21:56:22.445447 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 400/796] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:22 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1755 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:22.489103 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-febdfe2d-bb52-4d75-9185-6ae24420ab87 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:22.498657 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-febdfe2d-bb52-4d75-9185-6ae24420ab87 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:22.500108 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-febdfe2d-bb52-4d75-9185-6ae24420ab87 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:22.501341 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-febdfe2d-bb52-4d75-9185-6ae24420ab87 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.176401 Aug 29 21:56:22.501905 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 397/797] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:22 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:56:23.023480 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a425426f-4faa-4b38-8c35-3dcd38ab1739 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:23.024353 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a425426f-4faa-4b38-8c35-3dcd38ab1739 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:23.030837 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a425426f-4faa-4b38-8c35-3dcd38ab1739 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:23.031319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a425426f-4faa-4b38-8c35-3dcd38ab1739 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:23.031753 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a425426f-4faa-4b38-8c35-3dcd38ab1739 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:23.032458 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a425426f-4faa-4b38-8c35-3dcd38ab1739 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:23.032933 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a425426f-4faa-4b38-8c35-3dcd38ab1739 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:23.033381 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a425426f-4faa-4b38-8c35-3dcd38ab1739 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:23.171890 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a425426f-4faa-4b38-8c35-3dcd38ab1739 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:23.181581 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a425426f-4faa-4b38-8c35-3dcd38ab1739 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1512 microversion: 2.1 time: 0.161911 Aug 29 21:56:23.182324 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 401/798] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:23 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:23.467207 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-24a8165a-e233-4f89-bd4c-7401ee9ecc1f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:23.468070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-24a8165a-e233-4f89-bd4c-7401ee9ecc1f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:23.478566 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-24a8165a-e233-4f89-bd4c-7401ee9ecc1f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:23.479299 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-24a8165a-e233-4f89-bd4c-7401ee9ecc1f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:23.480579 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-24a8165a-e233-4f89-bd4c-7401ee9ecc1f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:23.480931 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-24a8165a-e233-4f89-bd4c-7401ee9ecc1f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:23.481419 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-24a8165a-e233-4f89-bd4c-7401ee9ecc1f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:23.481918 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-24a8165a-e233-4f89-bd4c-7401ee9ecc1f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:23.525931 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-09b75ee5-c24e-4a9f-bc46-38d3a99c779b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:23.527140 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-09b75ee5-c24e-4a9f-bc46-38d3a99c779b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:23.536042 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09b75ee5-c24e-4a9f-bc46-38d3a99c779b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:23.537004 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09b75ee5-c24e-4a9f-bc46-38d3a99c779b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:23.538246 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09b75ee5-c24e-4a9f-bc46-38d3a99c779b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:23.539185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09b75ee5-c24e-4a9f-bc46-38d3a99c779b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:23.539887 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09b75ee5-c24e-4a9f-bc46-38d3a99c779b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:23.540857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09b75ee5-c24e-4a9f-bc46-38d3a99c779b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:23.657225 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-24a8165a-e233-4f89-bd4c-7401ee9ecc1f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:23.666366 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-24a8165a-e233-4f89-bd4c-7401ee9ecc1f tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1755 microversion: 2.1 time: 0.204176 Aug 29 21:56:23.667301 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 398/799] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:23 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:23.723905 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-09b75ee5-c24e-4a9f-bc46-38d3a99c779b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:23.737911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-09b75ee5-c24e-4a9f-bc46-38d3a99c779b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:23.740763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-09b75ee5-c24e-4a9f-bc46-38d3a99c779b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:23.742719 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-09b75ee5-c24e-4a9f-bc46-38d3a99c779b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.221393 Aug 29 21:56:23.743711 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 402/800] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:23 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:24.202865 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-619a5ad2-2cbf-4f3f-ae44-9556d234c9cf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:24.203521 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-619a5ad2-2cbf-4f3f-ae44-9556d234c9cf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:24.210211 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-619a5ad2-2cbf-4f3f-ae44-9556d234c9cf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:24.210689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-619a5ad2-2cbf-4f3f-ae44-9556d234c9cf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:24.211132 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-619a5ad2-2cbf-4f3f-ae44-9556d234c9cf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:24.211860 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-619a5ad2-2cbf-4f3f-ae44-9556d234c9cf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:24.212320 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-619a5ad2-2cbf-4f3f-ae44-9556d234c9cf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:24.212958 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-619a5ad2-2cbf-4f3f-ae44-9556d234c9cf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:24.361898 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-619a5ad2-2cbf-4f3f-ae44-9556d234c9cf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:24.370817 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-619a5ad2-2cbf-4f3f-ae44-9556d234c9cf tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1512 microversion: 2.1 time: 0.171828 Aug 29 21:56:24.371522 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 399/801] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:24 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:24.691950 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e5fb290a-c784-481b-a31e-0ff8e3aa1aff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:24.692910 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-e5fb290a-c784-481b-a31e-0ff8e3aa1aff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:24.699764 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5fb290a-c784-481b-a31e-0ff8e3aa1aff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:24.700241 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5fb290a-c784-481b-a31e-0ff8e3aa1aff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:24.700710 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5fb290a-c784-481b-a31e-0ff8e3aa1aff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:24.701424 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5fb290a-c784-481b-a31e-0ff8e3aa1aff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:24.701887 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5fb290a-c784-481b-a31e-0ff8e3aa1aff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:24.702315 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e5fb290a-c784-481b-a31e-0ff8e3aa1aff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:24.770818 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-c59e01d8-1b9f-4592-aff1-637a6570d331 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:24.772587 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-c59e01d8-1b9f-4592-aff1-637a6570d331 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:24.783241 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c59e01d8-1b9f-4592-aff1-637a6570d331 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:24.784122 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c59e01d8-1b9f-4592-aff1-637a6570d331 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:24.784982 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c59e01d8-1b9f-4592-aff1-637a6570d331 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:24.786262 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c59e01d8-1b9f-4592-aff1-637a6570d331 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:24.787819 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c59e01d8-1b9f-4592-aff1-637a6570d331 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:24.788648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c59e01d8-1b9f-4592-aff1-637a6570d331 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:24.877196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e5fb290a-c784-481b-a31e-0ff8e3aa1aff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:24.887776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e5fb290a-c784-481b-a31e-0ff8e3aa1aff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1755 microversion: 2.1 time: 0.199690 Aug 29 21:56:24.888753 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 403/802] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:24 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:24.895318 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c67322a3-fda6-4c77-8bb3-caa11da672d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:56:24.896093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c67322a3-fda6-4c77-8bb3-caa11da672d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:24.905770 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c67322a3-fda6-4c77-8bb3-caa11da672d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:24.906571 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c67322a3-fda6-4c77-8bb3-caa11da672d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:24.907279 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c67322a3-fda6-4c77-8bb3-caa11da672d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:24.908420 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c67322a3-fda6-4c77-8bb3-caa11da672d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:24.909253 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c67322a3-fda6-4c77-8bb3-caa11da672d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:24.909988 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c67322a3-fda6-4c77-8bb3-caa11da672d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:24.938901 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-c67322a3-fda6-4c77-8bb3-caa11da672d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lazy-loading 'flavor' on Instance uuid b90c4eb2-99e9-4c0f-9336-0ecd87390a9f {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:56:24.970792 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-c59e01d8-1b9f-4592-aff1-637a6570d331 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:24.980602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-c59e01d8-1b9f-4592-aff1-637a6570d331 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:24.982159 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-c59e01d8-1b9f-4592-aff1-637a6570d331 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:24.983385 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-c59e01d8-1b9f-4592-aff1-637a6570d331 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.220417 Aug 29 21:56:24.983978 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 400/803] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:24 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:25.269273 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c67322a3-fda6-4c77-8bb3-caa11da672d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "POST /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f/action" status: 202 len: 0 microversion: 2.1 time: 0.379152 Aug 29 21:56:25.269873 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 404/804] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 21:56:24 2022] POST /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:56:25.279082 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4544c64d-50ca-441c-9664-90cff40a530f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:25.281820 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4544c64d-50ca-441c-9664-90cff40a530f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:25.286129 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4544c64d-50ca-441c-9664-90cff40a530f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:25.286631 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4544c64d-50ca-441c-9664-90cff40a530f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:25.287116 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4544c64d-50ca-441c-9664-90cff40a530f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:25.288045 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4544c64d-50ca-441c-9664-90cff40a530f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:25.288650 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4544c64d-50ca-441c-9664-90cff40a530f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:25.289091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4544c64d-50ca-441c-9664-90cff40a530f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:25.394858 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-1f7ff747-c454-4f20-84f0-e7aa1526a885 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:25.395905 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-1f7ff747-c454-4f20-84f0-e7aa1526a885 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:25.403879 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f7ff747-c454-4f20-84f0-e7aa1526a885 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:25.404378 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f7ff747-c454-4f20-84f0-e7aa1526a885 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:25.404857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f7ff747-c454-4f20-84f0-e7aa1526a885 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:25.405578 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f7ff747-c454-4f20-84f0-e7aa1526a885 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:25.406039 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f7ff747-c454-4f20-84f0-e7aa1526a885 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:25.406464 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1f7ff747-c454-4f20-84f0-e7aa1526a885 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:25.411409 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:25.465269 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4544c64d-50ca-441c-9664-90cff40a530f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:25.473921 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4544c64d-50ca-441c-9664-90cff40a530f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.198619 Aug 29 21:56:25.474885 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 401/805] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:25 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:25.582084 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1f7ff747-c454-4f20-84f0-e7aa1526a885 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:25.594045 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-1f7ff747-c454-4f20-84f0-e7aa1526a885 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1512 microversion: 2.1 time: 0.204373 Aug 29 21:56:25.597349 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 405/806] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:25 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:56:25.919647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-9cac10aa-7ed8-4e1e-b802-474e7462d932 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:25.920328 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-9cac10aa-7ed8-4e1e-b802-474e7462d932 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:25.927716 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9cac10aa-7ed8-4e1e-b802-474e7462d932 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:25.928714 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9cac10aa-7ed8-4e1e-b802-474e7462d932 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:25.929161 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9cac10aa-7ed8-4e1e-b802-474e7462d932 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:25.929877 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9cac10aa-7ed8-4e1e-b802-474e7462d932 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:25.930362 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9cac10aa-7ed8-4e1e-b802-474e7462d932 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:25.930796 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9cac10aa-7ed8-4e1e-b802-474e7462d932 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:25.947304 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:26.020813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-43d1795f-db87-48a8-945a-af2895e4961d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:26.021952 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-43d1795f-db87-48a8-945a-af2895e4961d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:26.032527 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-43d1795f-db87-48a8-945a-af2895e4961d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:26.032527 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-43d1795f-db87-48a8-945a-af2895e4961d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:26.032527 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-43d1795f-db87-48a8-945a-af2895e4961d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:26.033336 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-43d1795f-db87-48a8-945a-af2895e4961d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:26.033901 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-43d1795f-db87-48a8-945a-af2895e4961d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:26.034438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-43d1795f-db87-48a8-945a-af2895e4961d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:26.167316 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9cac10aa-7ed8-4e1e-b802-474e7462d932 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:26.181458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-9cac10aa-7ed8-4e1e-b802-474e7462d932 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1755 microversion: 2.1 time: 0.265668 Aug 29 21:56:26.182490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 402/807] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:25 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1755 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:26.214898 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-43d1795f-db87-48a8-945a-af2895e4961d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:26.223764 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-43d1795f-db87-48a8-945a-af2895e4961d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:26.225781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-43d1795f-db87-48a8-945a-af2895e4961d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:26.226990 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-43d1795f-db87-48a8-945a-af2895e4961d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.221285 Aug 29 21:56:26.238021 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 406/808] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:26 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:26.362532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-6c70c6bd-9117-40f6-8cb1-1fdacfd7af80 req-f59fac77-d5b6-4a4c-88e8-f6d6d2c56bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "315eda88-f51d-4b3a-8ff1-fdf6445d029c", "name": "network-vif-deleted", "tag": "dffc19a7-1747-4f43-8267-b48210d30291"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:56:26.374453 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-6c70c6bd-9117-40f6-8cb1-1fdacfd7af80 req-f59fac77-d5b6-4a4c-88e8-f6d6d2c56bbb service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:26.374940 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-6c70c6bd-9117-40f6-8cb1-1fdacfd7af80 req-f59fac77-d5b6-4a4c-88e8-f6d6d2c56bbb service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:26.375374 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-6c70c6bd-9117-40f6-8cb1-1fdacfd7af80 req-f59fac77-d5b6-4a4c-88e8-f6d6d2c56bbb service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:26.387647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-6c70c6bd-9117-40f6-8cb1-1fdacfd7af80 req-f59fac77-d5b6-4a4c-88e8-f6d6d2c56bbb service nova] Creating event network-vif-deleted:dffc19a7-1747-4f43-8267-b48210d30291 for instance 315eda88-f51d-4b3a-8ff1-fdf6445d029c on hv-cinder-85426 Aug 29 21:56:26.393815 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-6c70c6bd-9117-40f6-8cb1-1fdacfd7af80 req-f59fac77-d5b6-4a4c-88e8-f6d6d2c56bbb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114781 Aug 29 21:56:26.394438 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 403/809] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:56:26.496062 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-dd0bee8e-738a-4e93-9287-e8fcd6f700be tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:26.496725 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-dd0bee8e-738a-4e93-9287-e8fcd6f700be tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:26.502914 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dd0bee8e-738a-4e93-9287-e8fcd6f700be tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:26.503397 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dd0bee8e-738a-4e93-9287-e8fcd6f700be tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:26.503835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dd0bee8e-738a-4e93-9287-e8fcd6f700be tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:26.504575 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dd0bee8e-738a-4e93-9287-e8fcd6f700be tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:26.505035 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dd0bee8e-738a-4e93-9287-e8fcd6f700be tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:26.505462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dd0bee8e-738a-4e93-9287-e8fcd6f700be tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:26.619755 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8e4856c0-07f5-4c17-8c82-e7b6dcca77d7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:26.621036 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-8e4856c0-07f5-4c17-8c82-e7b6dcca77d7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:26.633735 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e4856c0-07f5-4c17-8c82-e7b6dcca77d7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:26.634634 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e4856c0-07f5-4c17-8c82-e7b6dcca77d7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:26.635441 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e4856c0-07f5-4c17-8c82-e7b6dcca77d7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:26.636877 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e4856c0-07f5-4c17-8c82-e7b6dcca77d7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:26.637745 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e4856c0-07f5-4c17-8c82-e7b6dcca77d7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:26.638564 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e4856c0-07f5-4c17-8c82-e7b6dcca77d7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:26.695932 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-dd0bee8e-738a-4e93-9287-e8fcd6f700be tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:26.707524 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-dd0bee8e-738a-4e93-9287-e8fcd6f700be tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.215317 Aug 29 21:56:26.708122 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 407/810] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:26 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:26.724872 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-8e4856c0-07f5-4c17-8c82-e7b6dcca77d7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:26.733450 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-8e4856c0-07f5-4c17-8c82-e7b6dcca77d7 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1303 microversion: 2.1 time: 0.121533 Aug 29 21:56:26.734164 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 404/811] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:26 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:27.205510 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6fe3e88f-be08-469b-9b75-c90b02d4e09c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:27.206402 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-6fe3e88f-be08-469b-9b75-c90b02d4e09c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:27.213226 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6fe3e88f-be08-469b-9b75-c90b02d4e09c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:27.213713 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6fe3e88f-be08-469b-9b75-c90b02d4e09c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:27.214152 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6fe3e88f-be08-469b-9b75-c90b02d4e09c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:27.214864 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6fe3e88f-be08-469b-9b75-c90b02d4e09c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:27.215313 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6fe3e88f-be08-469b-9b75-c90b02d4e09c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:27.215738 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6fe3e88f-be08-469b-9b75-c90b02d4e09c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:27.266991 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-079caa98-3edd-41fc-891f-19fbd509b26e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:27.267744 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-079caa98-3edd-41fc-891f-19fbd509b26e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:27.274446 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-079caa98-3edd-41fc-891f-19fbd509b26e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:27.275038 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-079caa98-3edd-41fc-891f-19fbd509b26e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:27.275566 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-079caa98-3edd-41fc-891f-19fbd509b26e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:27.276349 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-079caa98-3edd-41fc-891f-19fbd509b26e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:27.276905 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-079caa98-3edd-41fc-891f-19fbd509b26e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:27.277337 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-079caa98-3edd-41fc-891f-19fbd509b26e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:27.407848 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-6fe3e88f-be08-469b-9b75-c90b02d4e09c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:27.423644 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-6fe3e88f-be08-469b-9b75-c90b02d4e09c tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1755 microversion: 2.1 time: 0.222347 Aug 29 21:56:27.425132 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 408/812] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:27 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1755 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:27.436639 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-079caa98-3edd-41fc-891f-19fbd509b26e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:27.445478 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-079caa98-3edd-41fc-891f-19fbd509b26e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:27.446946 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-079caa98-3edd-41fc-891f-19fbd509b26e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:27.448144 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-079caa98-3edd-41fc-891f-19fbd509b26e tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.185101 Aug 29 21:56:27.448767 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 405/813] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:27 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:56:27.732547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4931423b-8748-45cd-a85b-e84c3b63f81c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:27.733171 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4931423b-8748-45cd-a85b-e84c3b63f81c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:27.739722 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4931423b-8748-45cd-a85b-e84c3b63f81c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:27.742519 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4931423b-8748-45cd-a85b-e84c3b63f81c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:27.742519 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4931423b-8748-45cd-a85b-e84c3b63f81c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:27.742519 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4931423b-8748-45cd-a85b-e84c3b63f81c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:27.742519 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4931423b-8748-45cd-a85b-e84c3b63f81c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:27.743080 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4931423b-8748-45cd-a85b-e84c3b63f81c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:27.755615 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-05762d91-8859-435f-ad63-b4feafe33109 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:27.756240 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-05762d91-8859-435f-ad63-b4feafe33109 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:27.763366 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-05762d91-8859-435f-ad63-b4feafe33109 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:27.763862 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-05762d91-8859-435f-ad63-b4feafe33109 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:27.764353 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-05762d91-8859-435f-ad63-b4feafe33109 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:27.765235 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-05762d91-8859-435f-ad63-b4feafe33109 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:27.765696 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-05762d91-8859-435f-ad63-b4feafe33109 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:27.766123 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-05762d91-8859-435f-ad63-b4feafe33109 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:27.808088 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-05762d91-8859-435f-ad63-b4feafe33109 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:27.808802 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-05762d91-8859-435f-ad63-b4feafe33109 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:27.809417 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-05762d91-8859-435f-ad63-b4feafe33109 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:27.810002 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-05762d91-8859-435f-ad63-b4feafe33109 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lazy-loading 'fault' on Instance uuid 315eda88-f51d-4b3a-8ff1-fdf6445d029c {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:56:27.864733 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-05762d91-8859-435f-ad63-b4feafe33109 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f617d6e3f3444cda7307794d7b8d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515d87b44484ec4904ec2303c9f1f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:27.879571 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-05762d91-8859-435f-ad63-b4feafe33109 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 200 len: 1308 microversion: 2.1 time: 0.127283 Aug 29 21:56:27.881770 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 406/814] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:27 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 1308 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:56:27.928185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4931423b-8748-45cd-a85b-e84c3b63f81c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:27.936270 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4931423b-8748-45cd-a85b-e84c3b63f81c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.207646 Aug 29 21:56:27.936884 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 409/815] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:27 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:28.450014 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-5770251d-be90-4032-a2ac-a8883f7f1a86 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:28.450629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-5770251d-be90-4032-a2ac-a8883f7f1a86 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:28.457023 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5770251d-be90-4032-a2ac-a8883f7f1a86 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:28.457546 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5770251d-be90-4032-a2ac-a8883f7f1a86 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:28.458006 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5770251d-be90-4032-a2ac-a8883f7f1a86 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:28.458756 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5770251d-be90-4032-a2ac-a8883f7f1a86 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:28.459215 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5770251d-be90-4032-a2ac-a8883f7f1a86 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:28.459648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5770251d-be90-4032-a2ac-a8883f7f1a86 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:28.470956 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c0dd726c-7697-49f7-848c-b3193f05c529 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:28.471713 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c0dd726c-7697-49f7-848c-b3193f05c529 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:28.478967 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c0dd726c-7697-49f7-848c-b3193f05c529 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:28.479461 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c0dd726c-7697-49f7-848c-b3193f05c529 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:28.479903 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c0dd726c-7697-49f7-848c-b3193f05c529 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:28.480685 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c0dd726c-7697-49f7-848c-b3193f05c529 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:28.481142 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c0dd726c-7697-49f7-848c-b3193f05c529 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:28.481564 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c0dd726c-7697-49f7-848c-b3193f05c529 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:28.625473 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-5770251d-be90-4032-a2ac-a8883f7f1a86 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:28.633674 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c0dd726c-7697-49f7-848c-b3193f05c529 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:28.634429 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-5770251d-be90-4032-a2ac-a8883f7f1a86 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1755 microversion: 2.1 time: 0.188280 Aug 29 21:56:28.635042 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 407/816] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:28 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:28.642539 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c0dd726c-7697-49f7-848c-b3193f05c529 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:28.643973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c0dd726c-7697-49f7-848c-b3193f05c529 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:28.645192 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c0dd726c-7697-49f7-848c-b3193f05c529 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.178087 Aug 29 21:56:28.645760 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 410/817] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:28 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:56:28.902155 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f0bd3b4d-8b65-467a-b1a9-3d939844cb31 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:28.902763 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f0bd3b4d-8b65-467a-b1a9-3d939844cb31 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] [instance: 315eda88-f51d-4b3a-8ff1-fdf6445d029c] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:28.909297 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f0bd3b4d-8b65-467a-b1a9-3d939844cb31 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:28.909831 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f0bd3b4d-8b65-467a-b1a9-3d939844cb31 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:28.910264 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f0bd3b4d-8b65-467a-b1a9-3d939844cb31 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:28.910986 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f0bd3b4d-8b65-467a-b1a9-3d939844cb31 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:28.911436 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f0bd3b4d-8b65-467a-b1a9-3d939844cb31 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:28.911861 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f0bd3b4d-8b65-467a-b1a9-3d939844cb31 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:28.926072 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-f0bd3b4d-8b65-467a-b1a9-3d939844cb31 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] HTTP exception thrown: Instance 315eda88-f51d-4b3a-8ff1-fdf6445d029c could not be found. Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f0bd3b4d-8b65-467a-b1a9-3d939844cb31 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Request method failure captured: Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c HTTP/1.1 Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTU_QSGUOk_j8qKwHy6GbsAenqtmHYL4JlJgf8jfbi3P6RZ9sKI9nbgVqTCIi2NvHjHhfo58t5-vOmzeTvj2pQb7JQzrTB92rgg6L3bIq8TzXLb2n8-GV43AXRnQcP2831GKUK-f5kSEY_a3_Y5qTTg2QnlKmYalFG4HLMKsGYCeGzQ Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: 1515d87b44484ec4904ec2303c9f1f33 Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1032545165 Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 21:56:28.927768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 21:56:28.929635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1515d87b44484ec4904ec2303c9f1f33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_1515d87b44484ec4904ec2303c9f1f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/1515d87b44484ec4904ec2303c9f1f33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/1515d87b44484ec4904ec2303c9f1f33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:56:28.929635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-VolumesSnapshotTestJSON-1032545165 Aug 29 21:56:28.929635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: 1515d87b44484ec4904ec2303c9f1f33 Aug 29 21:56:28.929635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1032545165 Aug 29 21:56:28.929635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-VolumesSnapshotTestJSON-1032545165-project Aug 29 21:56:28.929635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 21:56:28.929635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 21:56:28.929635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 9f617d6e3f3444cda7307794d7b8d837 Aug 29 21:56:28.929635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-VolumesSnapshotTestJSON-1032545165-project Aug 29 21:56:28.929635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 21:56:28.929635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance 315eda88-f51d-4b3a-8ff1-fdf6445d029c could not be found. Aug 29 21:56:28.929635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': '315eda88-f51d-4b3a-8ff1-fdf6445d029c'} Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 315eda88-f51d-4b3a-8ff1-fdf6445d029c could not be found. Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:56:28.930604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 315eda88-f51d-4b3a-8ff1-fdf6445d029c could not be found. Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 315eda88-f51d-4b3a-8ff1-fdf6445d029c could not be found. Aug 29 21:56:28.932105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:56:28.945549 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f0bd3b4d-8b65-467a-b1a9-3d939844cb31 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] Returning 404 to user: Instance 315eda88-f51d-4b3a-8ff1-fdf6445d029c could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:56:28.945549 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f0bd3b4d-8b65-467a-b1a9-3d939844cb31 tempest-VolumesSnapshotTestJSON-1032545165 tempest-VolumesSnapshotTestJSON-1032545165-project] 10.222.0.83 "GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c" status: 404 len: 111 microversion: 2.1 time: 0.030929 Aug 29 21:56:28.945549 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 408/818] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:28 2022] GET /compute/v2.1/servers/315eda88-f51d-4b3a-8ff1-fdf6445d029c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:56:28.966328 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-7ad26ea2-d3f2-48c4-8a81-ba2d3f941ce7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:28.966858 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-7ad26ea2-d3f2-48c4-8a81-ba2d3f941ce7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:28.974441 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7ad26ea2-d3f2-48c4-8a81-ba2d3f941ce7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:28.974933 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7ad26ea2-d3f2-48c4-8a81-ba2d3f941ce7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:28.975372 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7ad26ea2-d3f2-48c4-8a81-ba2d3f941ce7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:28.976147 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7ad26ea2-d3f2-48c4-8a81-ba2d3f941ce7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:28.976538 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7ad26ea2-d3f2-48c4-8a81-ba2d3f941ce7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:28.977205 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7ad26ea2-d3f2-48c4-8a81-ba2d3f941ce7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:29.134828 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-7ad26ea2-d3f2-48c4-8a81-ba2d3f941ce7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:29.143769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-7ad26ea2-d3f2-48c4-8a81-ba2d3f941ce7 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.181345 Aug 29 21:56:29.144358 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 411/819] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:28 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:29.657235 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-801143d3-e5f1-4207-a3b8-612adf3f4039 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:29.658110 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-801143d3-e5f1-4207-a3b8-612adf3f4039 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:29.665053 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-801143d3-e5f1-4207-a3b8-612adf3f4039 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:29.665574 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-801143d3-e5f1-4207-a3b8-612adf3f4039 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:29.666015 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-801143d3-e5f1-4207-a3b8-612adf3f4039 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:29.666792 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-801143d3-e5f1-4207-a3b8-612adf3f4039 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:29.667325 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-801143d3-e5f1-4207-a3b8-612adf3f4039 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:29.667748 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-801143d3-e5f1-4207-a3b8-612adf3f4039 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:29.680079 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-23f8c3bc-7e60-4ccc-a2bf-d5d66c74bea2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:29.681189 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-23f8c3bc-7e60-4ccc-a2bf-d5d66c74bea2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:29.690629 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-23f8c3bc-7e60-4ccc-a2bf-d5d66c74bea2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:29.691256 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-23f8c3bc-7e60-4ccc-a2bf-d5d66c74bea2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:29.691858 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-23f8c3bc-7e60-4ccc-a2bf-d5d66c74bea2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:29.692823 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-23f8c3bc-7e60-4ccc-a2bf-d5d66c74bea2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:29.693452 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-23f8c3bc-7e60-4ccc-a2bf-d5d66c74bea2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:29.694108 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-23f8c3bc-7e60-4ccc-a2bf-d5d66c74bea2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:29.860746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-801143d3-e5f1-4207-a3b8-612adf3f4039 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:29.863037 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-23f8c3bc-7e60-4ccc-a2bf-d5d66c74bea2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:29.872459 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-23f8c3bc-7e60-4ccc-a2bf-d5d66c74bea2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:29.873762 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-801143d3-e5f1-4207-a3b8-612adf3f4039 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1755 microversion: 2.1 time: 0.220205 Aug 29 21:56:29.874137 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-23f8c3bc-7e60-4ccc-a2bf-d5d66c74bea2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:29.874825 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 409/820] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:29 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1755 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:29.875614 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-23f8c3bc-7e60-4ccc-a2bf-d5d66c74bea2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.204157 Aug 29 21:56:29.876168 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 412/821] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:29 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:56:30.166817 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-c12e6d5b-1cd6-4b6d-af32-1f40c40dee25 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:30.167486 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-c12e6d5b-1cd6-4b6d-af32-1f40c40dee25 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:30.174873 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c12e6d5b-1cd6-4b6d-af32-1f40c40dee25 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:30.175374 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c12e6d5b-1cd6-4b6d-af32-1f40c40dee25 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:30.175816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c12e6d5b-1cd6-4b6d-af32-1f40c40dee25 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:30.176555 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c12e6d5b-1cd6-4b6d-af32-1f40c40dee25 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:30.177012 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c12e6d5b-1cd6-4b6d-af32-1f40c40dee25 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:30.177432 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c12e6d5b-1cd6-4b6d-af32-1f40c40dee25 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:30.330731 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-c12e6d5b-1cd6-4b6d-af32-1f40c40dee25 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:30.339409 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-c12e6d5b-1cd6-4b6d-af32-1f40c40dee25 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.176692 Aug 29 21:56:30.340020 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 410/822] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:30 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:56:30.897852 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-7aff05f5-52fd-4dd2-a6a5-0dcdaeed8d75 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:30.898613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-7aff05f5-52fd-4dd2-a6a5-0dcdaeed8d75 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:30.909260 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7aff05f5-52fd-4dd2-a6a5-0dcdaeed8d75 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:30.909898 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2c56fb83-540b-4730-a30a-1b959b28ce21 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:30.910563 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7aff05f5-52fd-4dd2-a6a5-0dcdaeed8d75 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:30.910766 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2c56fb83-540b-4730-a30a-1b959b28ce21 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:30.910934 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7aff05f5-52fd-4dd2-a6a5-0dcdaeed8d75 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:30.912972 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7aff05f5-52fd-4dd2-a6a5-0dcdaeed8d75 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:30.913415 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7aff05f5-52fd-4dd2-a6a5-0dcdaeed8d75 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:30.914237 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7aff05f5-52fd-4dd2-a6a5-0dcdaeed8d75 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:30.917520 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2c56fb83-540b-4730-a30a-1b959b28ce21 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:30.918018 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2c56fb83-540b-4730-a30a-1b959b28ce21 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:30.918458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2c56fb83-540b-4730-a30a-1b959b28ce21 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:30.919330 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2c56fb83-540b-4730-a30a-1b959b28ce21 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:30.919768 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2c56fb83-540b-4730-a30a-1b959b28ce21 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:30.920197 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2c56fb83-540b-4730-a30a-1b959b28ce21 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:31.108469 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2c56fb83-540b-4730-a30a-1b959b28ce21 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:31.125603 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2c56fb83-540b-4730-a30a-1b959b28ce21 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:31.133925 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2c56fb83-540b-4730-a30a-1b959b28ce21 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:31.133925 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2c56fb83-540b-4730-a30a-1b959b28ce21 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.224609 Aug 29 21:56:31.133925 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 411/823] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:30 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:56:31.142672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-7aff05f5-52fd-4dd2-a6a5-0dcdaeed8d75 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:31.159397 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-7aff05f5-52fd-4dd2-a6a5-0dcdaeed8d75 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1758 microversion: 2.1 time: 0.266515 Aug 29 21:56:31.160193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 413/824] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:30 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1758 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:31.372022 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-68f3d7ee-2685-499a-bf80-5951d9442dce tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:31.372862 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-68f3d7ee-2685-499a-bf80-5951d9442dce tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:31.379810 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-68f3d7ee-2685-499a-bf80-5951d9442dce tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:31.380299 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-68f3d7ee-2685-499a-bf80-5951d9442dce tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:31.381316 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-68f3d7ee-2685-499a-bf80-5951d9442dce tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:31.382065 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-68f3d7ee-2685-499a-bf80-5951d9442dce tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:31.382519 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-68f3d7ee-2685-499a-bf80-5951d9442dce tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:31.382942 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-68f3d7ee-2685-499a-bf80-5951d9442dce tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:31.544028 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-68f3d7ee-2685-499a-bf80-5951d9442dce tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:31.559862 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-68f3d7ee-2685-499a-bf80-5951d9442dce tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.192090 Aug 29 21:56:31.560996 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 412/825] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:31 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:32.170183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ac2f95ac-feec-4660-ad18-b77bf20a5a7d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:32.171361 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ac2f95ac-feec-4660-ad18-b77bf20a5a7d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:32.180771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ac2f95ac-feec-4660-ad18-b77bf20a5a7d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:32.181093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ac2f95ac-feec-4660-ad18-b77bf20a5a7d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:32.181533 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ac2f95ac-feec-4660-ad18-b77bf20a5a7d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:32.182241 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ac2f95ac-feec-4660-ad18-b77bf20a5a7d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:32.182693 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ac2f95ac-feec-4660-ad18-b77bf20a5a7d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:32.183120 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ac2f95ac-feec-4660-ad18-b77bf20a5a7d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:32.327108 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ac2f95ac-feec-4660-ad18-b77bf20a5a7d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:32.336281 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ac2f95ac-feec-4660-ad18-b77bf20a5a7d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:32.337768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ac2f95ac-feec-4660-ad18-b77bf20a5a7d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:32.338959 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ac2f95ac-feec-4660-ad18-b77bf20a5a7d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.174667 Aug 29 21:56:32.340164 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 414/826] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:32 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:32.582539 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-cf9de0a7-6deb-4b19-a8af-04ecbb63787c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:32.584828 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-cf9de0a7-6deb-4b19-a8af-04ecbb63787c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:32.590439 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cf9de0a7-6deb-4b19-a8af-04ecbb63787c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:32.591043 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cf9de0a7-6deb-4b19-a8af-04ecbb63787c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:32.591532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cf9de0a7-6deb-4b19-a8af-04ecbb63787c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:32.592360 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cf9de0a7-6deb-4b19-a8af-04ecbb63787c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:32.593064 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cf9de0a7-6deb-4b19-a8af-04ecbb63787c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:32.593552 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cf9de0a7-6deb-4b19-a8af-04ecbb63787c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:32.752973 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-cf9de0a7-6deb-4b19-a8af-04ecbb63787c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:32.761276 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-cf9de0a7-6deb-4b19-a8af-04ecbb63787c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.182794 Aug 29 21:56:32.761862 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 413/827] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:32 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:33.362646 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-cbd31537-6717-4528-bd4f-2c025217507b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:33.363297 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-cbd31537-6717-4528-bd4f-2c025217507b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:33.370383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbd31537-6717-4528-bd4f-2c025217507b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:33.370880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbd31537-6717-4528-bd4f-2c025217507b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:33.371405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbd31537-6717-4528-bd4f-2c025217507b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:33.372133 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbd31537-6717-4528-bd4f-2c025217507b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:33.373110 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbd31537-6717-4528-bd4f-2c025217507b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:33.373110 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbd31537-6717-4528-bd4f-2c025217507b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:33.523841 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-cbd31537-6717-4528-bd4f-2c025217507b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:33.532353 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-cbd31537-6717-4528-bd4f-2c025217507b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:33.533889 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-cbd31537-6717-4528-bd4f-2c025217507b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:33.535058 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-cbd31537-6717-4528-bd4f-2c025217507b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.176369 Aug 29 21:56:33.535656 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 415/828] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:33 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:33.785592 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e30d0db7-753b-4dfd-86cd-ec3bcd3b52aa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:33.786247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e30d0db7-753b-4dfd-86cd-ec3bcd3b52aa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:33.793059 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e30d0db7-753b-4dfd-86cd-ec3bcd3b52aa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:33.793544 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e30d0db7-753b-4dfd-86cd-ec3bcd3b52aa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:33.793972 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e30d0db7-753b-4dfd-86cd-ec3bcd3b52aa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:33.794669 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e30d0db7-753b-4dfd-86cd-ec3bcd3b52aa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:33.795116 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e30d0db7-753b-4dfd-86cd-ec3bcd3b52aa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:33.795539 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e30d0db7-753b-4dfd-86cd-ec3bcd3b52aa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:33.940625 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e30d0db7-753b-4dfd-86cd-ec3bcd3b52aa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:33.950705 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e30d0db7-753b-4dfd-86cd-ec3bcd3b52aa tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.168945 Aug 29 21:56:33.951371 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 414/829] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:33 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:56:34.558431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ed4ff276-4976-4a46-afad-7a0c0f95ba83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:34.559186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ed4ff276-4976-4a46-afad-7a0c0f95ba83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:34.565999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed4ff276-4976-4a46-afad-7a0c0f95ba83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:34.566498 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed4ff276-4976-4a46-afad-7a0c0f95ba83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:34.566908 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed4ff276-4976-4a46-afad-7a0c0f95ba83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:34.567622 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed4ff276-4976-4a46-afad-7a0c0f95ba83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:34.568100 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed4ff276-4976-4a46-afad-7a0c0f95ba83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:34.568519 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ed4ff276-4976-4a46-afad-7a0c0f95ba83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:34.705187 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ed4ff276-4976-4a46-afad-7a0c0f95ba83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:34.714283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ed4ff276-4976-4a46-afad-7a0c0f95ba83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:34.715692 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ed4ff276-4976-4a46-afad-7a0c0f95ba83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:34.716908 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ed4ff276-4976-4a46-afad-7a0c0f95ba83 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.162500 Aug 29 21:56:34.717446 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 416/830] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:34 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:34.972709 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-87839832-e90e-4580-82cb-3b7b9a3ce68d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:34.973379 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-87839832-e90e-4580-82cb-3b7b9a3ce68d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:34.980145 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87839832-e90e-4580-82cb-3b7b9a3ce68d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:34.980673 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87839832-e90e-4580-82cb-3b7b9a3ce68d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:34.981112 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87839832-e90e-4580-82cb-3b7b9a3ce68d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:34.981822 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87839832-e90e-4580-82cb-3b7b9a3ce68d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:34.982440 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87839832-e90e-4580-82cb-3b7b9a3ce68d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:34.982876 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87839832-e90e-4580-82cb-3b7b9a3ce68d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:35.134188 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-87839832-e90e-4580-82cb-3b7b9a3ce68d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:35.142810 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-87839832-e90e-4580-82cb-3b7b9a3ce68d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.174006 Aug 29 21:56:35.143401 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 415/831] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:34 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:35.742113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5dc71255-876b-4623-a6c1-a6fe6594039b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:35.742720 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5dc71255-876b-4623-a6c1-a6fe6594039b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:35.750515 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5dc71255-876b-4623-a6c1-a6fe6594039b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:35.751378 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5dc71255-876b-4623-a6c1-a6fe6594039b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:35.752155 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5dc71255-876b-4623-a6c1-a6fe6594039b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:35.753444 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5dc71255-876b-4623-a6c1-a6fe6594039b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:35.754300 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5dc71255-876b-4623-a6c1-a6fe6594039b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:35.755078 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5dc71255-876b-4623-a6c1-a6fe6594039b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:35.893210 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5dc71255-876b-4623-a6c1-a6fe6594039b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:35.902789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5dc71255-876b-4623-a6c1-a6fe6594039b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:35.905645 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5dc71255-876b-4623-a6c1-a6fe6594039b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:35.905645 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5dc71255-876b-4623-a6c1-a6fe6594039b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.168133 Aug 29 21:56:35.905948 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 417/832] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:35 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:36.165392 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-82776a84-ee35-4b29-b7b7-46b15ed91591 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:36.166016 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-82776a84-ee35-4b29-b7b7-46b15ed91591 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:36.172884 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-82776a84-ee35-4b29-b7b7-46b15ed91591 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:36.173630 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-82776a84-ee35-4b29-b7b7-46b15ed91591 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:36.174065 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-82776a84-ee35-4b29-b7b7-46b15ed91591 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:36.174765 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-82776a84-ee35-4b29-b7b7-46b15ed91591 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:36.175210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-82776a84-ee35-4b29-b7b7-46b15ed91591 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:36.175631 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-82776a84-ee35-4b29-b7b7-46b15ed91591 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:36.314928 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d889e582-73d2-45cb-a357-f596d2ee34f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:36.315440 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d889e582-73d2-45cb-a357-f596d2ee34f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:36.319322 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-82776a84-ee35-4b29-b7b7-46b15ed91591 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:36.322465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d889e582-73d2-45cb-a357-f596d2ee34f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:36.322971 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d889e582-73d2-45cb-a357-f596d2ee34f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:36.323418 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d889e582-73d2-45cb-a357-f596d2ee34f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:36.324167 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d889e582-73d2-45cb-a357-f596d2ee34f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:36.324674 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d889e582-73d2-45cb-a357-f596d2ee34f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:36.325104 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d889e582-73d2-45cb-a357-f596d2ee34f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:36.327685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-82776a84-ee35-4b29-b7b7-46b15ed91591 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.166919 Aug 29 21:56:36.328278 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 416/833] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:36 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:56:36.417405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-d889e582-73d2-45cb-a357-f596d2ee34f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lazy-loading 'services' on Instance uuid 945580b2-8dd8-43c7-a485-9501fd158032 {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:56:36.686746 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d889e582-73d2-45cb-a357-f596d2ee34f2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "DELETE /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-volume_attachments/43ccf79f-6fb7-4b0d-bf5c-3544769e9eaf" status: 202 len: 0 microversion: 2.1 time: 0.375528 Aug 29 21:56:36.691834 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 418/834] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 21:56:36 2022] DELETE /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-volume_attachments/43ccf79f-6fb7-4b0d-bf5c-3544769e9eaf => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:56:36.697316 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-9ffd73e1-133c-426a-aeb6-60b42d8c2c05 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:36.700250 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-9ffd73e1-133c-426a-aeb6-60b42d8c2c05 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:36.708319 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9ffd73e1-133c-426a-aeb6-60b42d8c2c05 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:36.709605 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9ffd73e1-133c-426a-aeb6-60b42d8c2c05 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:36.710111 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9ffd73e1-133c-426a-aeb6-60b42d8c2c05 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:36.710907 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9ffd73e1-133c-426a-aeb6-60b42d8c2c05 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:36.711424 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9ffd73e1-133c-426a-aeb6-60b42d8c2c05 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:36.712010 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9ffd73e1-133c-426a-aeb6-60b42d8c2c05 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:36.744671 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-9ffd73e1-133c-426a-aeb6-60b42d8c2c05 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052554 Aug 29 21:56:36.745262 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 417/835] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 21:56:36 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:56:36.932873 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-880cc408-0181-40f1-9bde-36896484da04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:36.933591 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-880cc408-0181-40f1-9bde-36896484da04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:36.940439 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-880cc408-0181-40f1-9bde-36896484da04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:36.941000 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-880cc408-0181-40f1-9bde-36896484da04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:36.941447 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-880cc408-0181-40f1-9bde-36896484da04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:36.942171 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-880cc408-0181-40f1-9bde-36896484da04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:36.942635 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-880cc408-0181-40f1-9bde-36896484da04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:36.943063 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-880cc408-0181-40f1-9bde-36896484da04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:37.112174 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-880cc408-0181-40f1-9bde-36896484da04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:37.128858 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-880cc408-0181-40f1-9bde-36896484da04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:37.132410 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-880cc408-0181-40f1-9bde-36896484da04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:37.134745 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-880cc408-0181-40f1-9bde-36896484da04 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.208157 Aug 29 21:56:37.135833 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 419/836] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:36 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:37.350669 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f257a00d-79a1-4020-bfee-2810c8d61a22 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:37.351282 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f257a00d-79a1-4020-bfee-2810c8d61a22 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:37.362072 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f257a00d-79a1-4020-bfee-2810c8d61a22 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:37.365920 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f257a00d-79a1-4020-bfee-2810c8d61a22 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:37.365920 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f257a00d-79a1-4020-bfee-2810c8d61a22 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:37.365920 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f257a00d-79a1-4020-bfee-2810c8d61a22 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:37.366464 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f257a00d-79a1-4020-bfee-2810c8d61a22 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:37.367259 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f257a00d-79a1-4020-bfee-2810c8d61a22 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:37.530449 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f257a00d-79a1-4020-bfee-2810c8d61a22 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:37.539384 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f257a00d-79a1-4020-bfee-2810c8d61a22 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.193065 Aug 29 21:56:37.539975 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 418/837] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:37 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:37.758942 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5c95e09a-e500-4ad9-b798-e583bf23d351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:37.761363 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5c95e09a-e500-4ad9-b798-e583bf23d351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:37.768048 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5c95e09a-e500-4ad9-b798-e583bf23d351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:37.768581 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5c95e09a-e500-4ad9-b798-e583bf23d351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:37.769026 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5c95e09a-e500-4ad9-b798-e583bf23d351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:37.769743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5c95e09a-e500-4ad9-b798-e583bf23d351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:37.770198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5c95e09a-e500-4ad9-b798-e583bf23d351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:37.770629 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5c95e09a-e500-4ad9-b798-e583bf23d351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:37.805346 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5c95e09a-e500-4ad9-b798-e583bf23d351 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050452 Aug 29 21:56:37.805943 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 420/838] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 21:56:37 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:56:38.175549 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6ac7bfa4-dd84-4795-88e7-f6994b603d40 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:38.176564 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6ac7bfa4-dd84-4795-88e7-f6994b603d40 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:38.179071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:38.184698 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6ac7bfa4-dd84-4795-88e7-f6994b603d40 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:38.185220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6ac7bfa4-dd84-4795-88e7-f6994b603d40 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:38.185676 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6ac7bfa4-dd84-4795-88e7-f6994b603d40 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:38.186435 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6ac7bfa4-dd84-4795-88e7-f6994b603d40 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:38.186917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6ac7bfa4-dd84-4795-88e7-f6994b603d40 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:38.187428 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6ac7bfa4-dd84-4795-88e7-f6994b603d40 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:38.347640 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6ac7bfa4-dd84-4795-88e7-f6994b603d40 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:38.356102 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6ac7bfa4-dd84-4795-88e7-f6994b603d40 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:38.357586 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6ac7bfa4-dd84-4795-88e7-f6994b603d40 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:38.358793 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6ac7bfa4-dd84-4795-88e7-f6994b603d40 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.188006 Aug 29 21:56:38.362289 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 419/839] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:38 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:56:38.561855 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-53a415e8-57fc-44a7-b63a-8c79eef42a12 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:38.562443 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-53a415e8-57fc-44a7-b63a-8c79eef42a12 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:38.569839 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-53a415e8-57fc-44a7-b63a-8c79eef42a12 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:38.570335 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-53a415e8-57fc-44a7-b63a-8c79eef42a12 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:38.570774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-53a415e8-57fc-44a7-b63a-8c79eef42a12 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:38.571480 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-53a415e8-57fc-44a7-b63a-8c79eef42a12 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:38.571963 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-53a415e8-57fc-44a7-b63a-8c79eef42a12 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:38.572366 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-53a415e8-57fc-44a7-b63a-8c79eef42a12 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:38.577051 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:38.714925 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-53a415e8-57fc-44a7-b63a-8c79eef42a12 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:38.723345 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-53a415e8-57fc-44a7-b63a-8c79eef42a12 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.165667 Aug 29 21:56:38.723940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 421/840] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:38 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:38.818581 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-3c69437d-5501-481f-8d81-6c6e21fd472e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:38.820737 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-3c69437d-5501-481f-8d81-6c6e21fd472e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:38.827644 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3c69437d-5501-481f-8d81-6c6e21fd472e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:38.828133 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3c69437d-5501-481f-8d81-6c6e21fd472e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:38.828599 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3c69437d-5501-481f-8d81-6c6e21fd472e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:38.829303 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3c69437d-5501-481f-8d81-6c6e21fd472e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:38.829754 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3c69437d-5501-481f-8d81-6c6e21fd472e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:38.830176 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3c69437d-5501-481f-8d81-6c6e21fd472e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:38.832932 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=100 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:38.863082 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-3c69437d-5501-481f-8d81-6c6e21fd472e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048744 Aug 29 21:56:38.863664 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 420/841] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 21:56:38 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:56:38.952784 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-81afe98f-b6c3-4b68-9cd1-78d7658f2d7c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:38.953296 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-81afe98f-b6c3-4b68-9cd1-78d7658f2d7c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:38.960105 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81afe98f-b6c3-4b68-9cd1-78d7658f2d7c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:38.960738 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81afe98f-b6c3-4b68-9cd1-78d7658f2d7c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:38.961192 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81afe98f-b6c3-4b68-9cd1-78d7658f2d7c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:38.961928 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81afe98f-b6c3-4b68-9cd1-78d7658f2d7c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:38.962393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81afe98f-b6c3-4b68-9cd1-78d7658f2d7c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:38.962862 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81afe98f-b6c3-4b68-9cd1-78d7658f2d7c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:38.993166 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-81afe98f-b6c3-4b68-9cd1-78d7658f2d7c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Going to try to terminate instance {{(pid=127882) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:56:39.314766 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-81afe98f-b6c3-4b68-9cd1-78d7658f2d7c tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "DELETE /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 204 len: 0 microversion: 2.1 time: 0.365719 Aug 29 21:56:39.315271 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 422/842] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:56:38 2022] DELETE /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:56:39.335566 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-bf32bed6-371e-4f03-a89e-c7b758151f61 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:39.338039 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-bf32bed6-371e-4f03-a89e-c7b758151f61 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:39.350613 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bf32bed6-371e-4f03-a89e-c7b758151f61 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:39.351574 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bf32bed6-371e-4f03-a89e-c7b758151f61 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:39.352755 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bf32bed6-371e-4f03-a89e-c7b758151f61 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:39.353762 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bf32bed6-371e-4f03-a89e-c7b758151f61 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:39.354287 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bf32bed6-371e-4f03-a89e-c7b758151f61 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:39.354769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bf32bed6-371e-4f03-a89e-c7b758151f61 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:39.383694 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-63d653a3-668c-43ca-8801-4c20174c2b63 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:39.384788 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-63d653a3-668c-43ca-8801-4c20174c2b63 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:39.395173 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-63d653a3-668c-43ca-8801-4c20174c2b63 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:39.396147 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-63d653a3-668c-43ca-8801-4c20174c2b63 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:39.397571 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-63d653a3-668c-43ca-8801-4c20174c2b63 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:39.398849 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-63d653a3-668c-43ca-8801-4c20174c2b63 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:39.399727 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-63d653a3-668c-43ca-8801-4c20174c2b63 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:39.400453 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-63d653a3-668c-43ca-8801-4c20174c2b63 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:39.535316 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-bf32bed6-371e-4f03-a89e-c7b758151f61 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:39.550606 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-bf32bed6-371e-4f03-a89e-c7b758151f61 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1690 microversion: 2.1 time: 0.229257 Aug 29 21:56:39.551676 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 421/843] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:39 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1690 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:56:39.577711 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-63d653a3-668c-43ca-8801-4c20174c2b63 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:39.593847 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-63d653a3-668c-43ca-8801-4c20174c2b63 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:39.596924 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-63d653a3-668c-43ca-8801-4c20174c2b63 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:39.599211 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-63d653a3-668c-43ca-8801-4c20174c2b63 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.221036 Aug 29 21:56:39.600277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 423/844] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:39 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:56:39.745899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-1b4c9ea3-9481-4036-b7fd-60a6c3e4600d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:39.746696 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-1b4c9ea3-9481-4036-b7fd-60a6c3e4600d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:39.753410 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1b4c9ea3-9481-4036-b7fd-60a6c3e4600d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:39.753896 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1b4c9ea3-9481-4036-b7fd-60a6c3e4600d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:39.754333 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1b4c9ea3-9481-4036-b7fd-60a6c3e4600d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:39.755042 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1b4c9ea3-9481-4036-b7fd-60a6c3e4600d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:39.755500 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1b4c9ea3-9481-4036-b7fd-60a6c3e4600d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:39.756533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1b4c9ea3-9481-4036-b7fd-60a6c3e4600d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:39.903224 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-1b4c9ea3-9481-4036-b7fd-60a6c3e4600d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:39.913689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-1b4c9ea3-9481-4036-b7fd-60a6c3e4600d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.171592 Aug 29 21:56:39.914409 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 422/845] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:39 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:40.587451 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5a90415c-56b8-4b34-9e95-8b341dd3c750 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:40.588591 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5a90415c-56b8-4b34-9e95-8b341dd3c750 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:40.600193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5a90415c-56b8-4b34-9e95-8b341dd3c750 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:40.600880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5a90415c-56b8-4b34-9e95-8b341dd3c750 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:40.601424 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5a90415c-56b8-4b34-9e95-8b341dd3c750 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:40.602476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5a90415c-56b8-4b34-9e95-8b341dd3c750 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:40.603296 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5a90415c-56b8-4b34-9e95-8b341dd3c750 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:40.604102 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5a90415c-56b8-4b34-9e95-8b341dd3c750 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:40.623366 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6247d376-1743-4d5f-aa36-15a83bc339c2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:40.624134 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6247d376-1743-4d5f-aa36-15a83bc339c2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:40.631616 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6247d376-1743-4d5f-aa36-15a83bc339c2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:40.632348 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6247d376-1743-4d5f-aa36-15a83bc339c2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:40.632881 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6247d376-1743-4d5f-aa36-15a83bc339c2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:40.633745 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6247d376-1743-4d5f-aa36-15a83bc339c2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:40.634408 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6247d376-1743-4d5f-aa36-15a83bc339c2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:40.635217 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6247d376-1743-4d5f-aa36-15a83bc339c2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:40.783863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6247d376-1743-4d5f-aa36-15a83bc339c2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:40.793266 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6247d376-1743-4d5f-aa36-15a83bc339c2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:40.793463 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5a90415c-56b8-4b34-9e95-8b341dd3c750 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:40.794984 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6247d376-1743-4d5f-aa36-15a83bc339c2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:40.796256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6247d376-1743-4d5f-aa36-15a83bc339c2 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.176944 Aug 29 21:56:40.796898 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 423/846] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:40 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:56:40.802204 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5a90415c-56b8-4b34-9e95-8b341dd3c750 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1690 microversion: 2.1 time: 0.221666 Aug 29 21:56:40.810757 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 424/847] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:40 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:40.937264 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0798e66b-8939-404f-a688-c83de7f3fd40 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:40.937897 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0798e66b-8939-404f-a688-c83de7f3fd40 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:40.945585 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0798e66b-8939-404f-a688-c83de7f3fd40 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:40.946085 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0798e66b-8939-404f-a688-c83de7f3fd40 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:40.946528 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0798e66b-8939-404f-a688-c83de7f3fd40 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:40.947246 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0798e66b-8939-404f-a688-c83de7f3fd40 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:40.947713 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0798e66b-8939-404f-a688-c83de7f3fd40 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:40.948147 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0798e66b-8939-404f-a688-c83de7f3fd40 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:41.118944 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0798e66b-8939-404f-a688-c83de7f3fd40 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:41.133686 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0798e66b-8939-404f-a688-c83de7f3fd40 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.199874 Aug 29 21:56:41.134730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 424/848] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:40 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:41.819887 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ece500e1-a7fa-45bc-96d0-450e6fa085a3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:41.820535 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ece500e1-a7fa-45bc-96d0-450e6fa085a3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:41.828682 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ece500e1-a7fa-45bc-96d0-450e6fa085a3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:41.829319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ece500e1-a7fa-45bc-96d0-450e6fa085a3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:41.829842 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ece500e1-a7fa-45bc-96d0-450e6fa085a3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:41.830750 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ece500e1-a7fa-45bc-96d0-450e6fa085a3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:41.831353 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ece500e1-a7fa-45bc-96d0-450e6fa085a3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:41.831837 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ece500e1-a7fa-45bc-96d0-450e6fa085a3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:41.832331 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-119ba3eb-3f2b-4f02-a22d-b110b0278ad1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:41.834474 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-119ba3eb-3f2b-4f02-a22d-b110b0278ad1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:41.841058 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-119ba3eb-3f2b-4f02-a22d-b110b0278ad1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:41.841699 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-119ba3eb-3f2b-4f02-a22d-b110b0278ad1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:41.842269 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-119ba3eb-3f2b-4f02-a22d-b110b0278ad1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:41.843095 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-119ba3eb-3f2b-4f02-a22d-b110b0278ad1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:41.843682 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-119ba3eb-3f2b-4f02-a22d-b110b0278ad1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:41.844245 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-119ba3eb-3f2b-4f02-a22d-b110b0278ad1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:42.002107 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-119ba3eb-3f2b-4f02-a22d-b110b0278ad1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:42.020533 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ece500e1-a7fa-45bc-96d0-450e6fa085a3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:42.021070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-119ba3eb-3f2b-4f02-a22d-b110b0278ad1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1690 microversion: 2.1 time: 0.190044 Aug 29 21:56:42.021070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 425/849] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:41 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:56:42.026883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ece500e1-a7fa-45bc-96d0-450e6fa085a3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:42.028452 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ece500e1-a7fa-45bc-96d0-450e6fa085a3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:42.030013 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ece500e1-a7fa-45bc-96d0-450e6fa085a3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.214137 Aug 29 21:56:42.030872 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 425/850] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:41 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:56:42.155828 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-3899c5bf-8e4a-44b8-93cb-a6fcc7407218 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:42.156359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-3899c5bf-8e4a-44b8-93cb-a6fcc7407218 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:42.163244 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3899c5bf-8e4a-44b8-93cb-a6fcc7407218 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:42.163737 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3899c5bf-8e4a-44b8-93cb-a6fcc7407218 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:42.164191 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3899c5bf-8e4a-44b8-93cb-a6fcc7407218 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:42.164947 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3899c5bf-8e4a-44b8-93cb-a6fcc7407218 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:42.165414 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3899c5bf-8e4a-44b8-93cb-a6fcc7407218 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:42.165852 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3899c5bf-8e4a-44b8-93cb-a6fcc7407218 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:42.330915 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-3899c5bf-8e4a-44b8-93cb-a6fcc7407218 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:42.339740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-3899c5bf-8e4a-44b8-93cb-a6fcc7407218 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.187801 Aug 29 21:56:42.340331 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 426/851] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:42 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:56:43.042569 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9db059b6-c521-4fb6-aa3d-3467d7887b1a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:43.043236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9db059b6-c521-4fb6-aa3d-3467d7887b1a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:43.045403 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:43.050866 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9db059b6-c521-4fb6-aa3d-3467d7887b1a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:43.051363 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9db059b6-c521-4fb6-aa3d-3467d7887b1a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:43.051806 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9db059b6-c521-4fb6-aa3d-3467d7887b1a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:43.052539 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9db059b6-c521-4fb6-aa3d-3467d7887b1a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:43.053004 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9db059b6-c521-4fb6-aa3d-3467d7887b1a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:43.053437 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9db059b6-c521-4fb6-aa3d-3467d7887b1a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:43.067927 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-9337529d-8c64-4808-a2b9-b71e259a55cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:43.068609 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-9337529d-8c64-4808-a2b9-b71e259a55cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:43.075736 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9337529d-8c64-4808-a2b9-b71e259a55cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:43.076119 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9337529d-8c64-4808-a2b9-b71e259a55cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:43.077019 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9337529d-8c64-4808-a2b9-b71e259a55cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:43.077656 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9337529d-8c64-4808-a2b9-b71e259a55cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:43.080868 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9337529d-8c64-4808-a2b9-b71e259a55cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:43.080868 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9337529d-8c64-4808-a2b9-b71e259a55cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:43.213057 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9db059b6-c521-4fb6-aa3d-3467d7887b1a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:43.222212 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9db059b6-c521-4fb6-aa3d-3467d7887b1a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1690 microversion: 2.1 time: 0.183669 Aug 29 21:56:43.222884 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 426/852] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:43 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1690 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:43.231917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9337529d-8c64-4808-a2b9-b71e259a55cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:43.240875 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9337529d-8c64-4808-a2b9-b71e259a55cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:43.242307 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9337529d-8c64-4808-a2b9-b71e259a55cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:43.243477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-9337529d-8c64-4808-a2b9-b71e259a55cb tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.179819 Aug 29 21:56:43.244033 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 427/853] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:43 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:56:43.361942 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4e4b1956-e740-4994-a7c1-2bb1c87bb2d1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:43.362679 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4e4b1956-e740-4994-a7c1-2bb1c87bb2d1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:43.369077 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4e4b1956-e740-4994-a7c1-2bb1c87bb2d1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:43.369574 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4e4b1956-e740-4994-a7c1-2bb1c87bb2d1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:43.370019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4e4b1956-e740-4994-a7c1-2bb1c87bb2d1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:43.374705 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4e4b1956-e740-4994-a7c1-2bb1c87bb2d1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:43.374705 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4e4b1956-e740-4994-a7c1-2bb1c87bb2d1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:43.374705 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4e4b1956-e740-4994-a7c1-2bb1c87bb2d1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:43.519965 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4e4b1956-e740-4994-a7c1-2bb1c87bb2d1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:43.529106 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4e4b1956-e740-4994-a7c1-2bb1c87bb2d1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.170964 Aug 29 21:56:43.529706 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 427/854] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:43 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:44.257411 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-23f2a3a7-470a-416f-8fd2-2e2017c86d62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:44.257411 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-23f2a3a7-470a-416f-8fd2-2e2017c86d62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:44.260905 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-23f2a3a7-470a-416f-8fd2-2e2017c86d62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:44.261673 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-23f2a3a7-470a-416f-8fd2-2e2017c86d62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:44.262192 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-23f2a3a7-470a-416f-8fd2-2e2017c86d62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:44.263544 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-23f2a3a7-470a-416f-8fd2-2e2017c86d62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:44.264151 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-23f2a3a7-470a-416f-8fd2-2e2017c86d62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:44.265004 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-23f2a3a7-470a-416f-8fd2-2e2017c86d62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:44.279720 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b8f9abd1-9aa6-4331-ae15-ec2181ec120a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:44.280547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b8f9abd1-9aa6-4331-ae15-ec2181ec120a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:44.300070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b8f9abd1-9aa6-4331-ae15-ec2181ec120a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:44.300806 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b8f9abd1-9aa6-4331-ae15-ec2181ec120a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:44.301303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b8f9abd1-9aa6-4331-ae15-ec2181ec120a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:44.302227 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b8f9abd1-9aa6-4331-ae15-ec2181ec120a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:44.302928 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b8f9abd1-9aa6-4331-ae15-ec2181ec120a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:44.303372 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b8f9abd1-9aa6-4331-ae15-ec2181ec120a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:44.477916 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b8f9abd1-9aa6-4331-ae15-ec2181ec120a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:44.489548 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b8f9abd1-9aa6-4331-ae15-ec2181ec120a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:44.491090 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b8f9abd1-9aa6-4331-ae15-ec2181ec120a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:44.492843 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b8f9abd1-9aa6-4331-ae15-ec2181ec120a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1745 microversion: 2.20 time: 0.217962 Aug 29 21:56:44.505508 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 428/855] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:44 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1745 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:56:44.565261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-76cc253d-b5a1-4ad0-b0c0-e34e50248341 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:44.565261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-76cc253d-b5a1-4ad0-b0c0-e34e50248341 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:44.573203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-76cc253d-b5a1-4ad0-b0c0-e34e50248341 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:44.574185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-76cc253d-b5a1-4ad0-b0c0-e34e50248341 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:44.575064 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-76cc253d-b5a1-4ad0-b0c0-e34e50248341 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:44.576584 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-76cc253d-b5a1-4ad0-b0c0-e34e50248341 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:44.577542 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-76cc253d-b5a1-4ad0-b0c0-e34e50248341 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:44.581315 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-76cc253d-b5a1-4ad0-b0c0-e34e50248341 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:44.802543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-76cc253d-b5a1-4ad0-b0c0-e34e50248341 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:44.814560 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-76cc253d-b5a1-4ad0-b0c0-e34e50248341 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.260503 Aug 29 21:56:44.815567 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 429/856] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:44 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:44.971951 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-23f2a3a7-470a-416f-8fd2-2e2017c86d62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:44.981801 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-23f2a3a7-470a-416f-8fd2-2e2017c86d62 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1690 microversion: 2.1 time: 0.737603 Aug 29 21:56:44.982513 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 428/857] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:44 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1690 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:45.518743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2bc74191-8e83-4c1d-ac27-bdcf9d85c53d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:45.519510 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2bc74191-8e83-4c1d-ac27-bdcf9d85c53d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:45.526914 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2bc74191-8e83-4c1d-ac27-bdcf9d85c53d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:45.527457 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2bc74191-8e83-4c1d-ac27-bdcf9d85c53d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:45.527902 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2bc74191-8e83-4c1d-ac27-bdcf9d85c53d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:45.528657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2bc74191-8e83-4c1d-ac27-bdcf9d85c53d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:45.529158 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2bc74191-8e83-4c1d-ac27-bdcf9d85c53d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:45.529624 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2bc74191-8e83-4c1d-ac27-bdcf9d85c53d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:45.704427 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2bc74191-8e83-4c1d-ac27-bdcf9d85c53d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:45.723116 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2bc74191-8e83-4c1d-ac27-bdcf9d85c53d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:45.727040 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2bc74191-8e83-4c1d-ac27-bdcf9d85c53d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:45.729242 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2bc74191-8e83-4c1d-ac27-bdcf9d85c53d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1745 microversion: 2.20 time: 0.214142 Aug 29 21:56:45.730718 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 430/858] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:45 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1745 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:45.791655 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-c4765220-fe23-43cb-9aea-f057830ef761 req-d49e4384-7293-4280-89c5-a05a131254b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "945580b2-8dd8-43c7-a485-9501fd158032", "name": "network-vif-deleted", "tag": "caed18b7-a71c-45cd-90a8-5ac5f1382523"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:56:45.803275 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-c4765220-fe23-43cb-9aea-f057830ef761 req-d49e4384-7293-4280-89c5-a05a131254b5 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:45.803822 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-c4765220-fe23-43cb-9aea-f057830ef761 req-d49e4384-7293-4280-89c5-a05a131254b5 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:45.804249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-c4765220-fe23-43cb-9aea-f057830ef761 req-d49e4384-7293-4280-89c5-a05a131254b5 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:45.821639 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-c4765220-fe23-43cb-9aea-f057830ef761 req-d49e4384-7293-4280-89c5-a05a131254b5 service nova] Creating event network-vif-deleted:caed18b7-a71c-45cd-90a8-5ac5f1382523 for instance 945580b2-8dd8-43c7-a485-9501fd158032 on hv-cinder-85426 Aug 29 21:56:45.828020 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-c4765220-fe23-43cb-9aea-f057830ef761 req-d49e4384-7293-4280-89c5-a05a131254b5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039696 Aug 29 21:56:45.828823 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 429/859] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:56:45.851006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0691e6d1-ead0-484e-888a-8eb599ee6f8c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:45.852430 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-0691e6d1-ead0-484e-888a-8eb599ee6f8c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:45.863275 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0691e6d1-ead0-484e-888a-8eb599ee6f8c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:45.864265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0691e6d1-ead0-484e-888a-8eb599ee6f8c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:45.864987 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0691e6d1-ead0-484e-888a-8eb599ee6f8c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:45.866008 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0691e6d1-ead0-484e-888a-8eb599ee6f8c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:45.866668 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0691e6d1-ead0-484e-888a-8eb599ee6f8c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:45.867363 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0691e6d1-ead0-484e-888a-8eb599ee6f8c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:45.887243 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-3f69b59c-060b-4526-beca-3097b4f9bd85 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:45.890147 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-3f69b59c-060b-4526-beca-3097b4f9bd85 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:45.922578 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3f69b59c-060b-4526-beca-3097b4f9bd85 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:45.922578 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3f69b59c-060b-4526-beca-3097b4f9bd85 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:45.922907 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3f69b59c-060b-4526-beca-3097b4f9bd85 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:45.924087 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3f69b59c-060b-4526-beca-3097b4f9bd85 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:45.924447 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3f69b59c-060b-4526-beca-3097b4f9bd85 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:45.924987 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3f69b59c-060b-4526-beca-3097b4f9bd85 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:45.976238 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-3f69b59c-060b-4526-beca-3097b4f9bd85 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/ips" status: 200 len: 147 microversion: 2.1 time: 0.098354 Aug 29 21:56:45.983270 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 430/860] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 21:56:45 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/ips => generated 147 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:56:46.005539 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b519a48c-62cc-4851-9a81-55bb3e52848b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:46.006619 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b519a48c-62cc-4851-9a81-55bb3e52848b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:46.027127 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b519a48c-62cc-4851-9a81-55bb3e52848b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:46.027786 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b519a48c-62cc-4851-9a81-55bb3e52848b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:46.028257 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b519a48c-62cc-4851-9a81-55bb3e52848b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:46.033301 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b519a48c-62cc-4851-9a81-55bb3e52848b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:46.033869 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b519a48c-62cc-4851-9a81-55bb3e52848b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:46.034334 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b519a48c-62cc-4851-9a81-55bb3e52848b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:46.119653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b519a48c-62cc-4851-9a81-55bb3e52848b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:46.122289 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-0691e6d1-ead0-484e-888a-8eb599ee6f8c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:46.134755 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-0691e6d1-ead0-484e-888a-8eb599ee6f8c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.289539 Aug 29 21:56:46.152520 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b519a48c-62cc-4851-9a81-55bb3e52848b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1622 microversion: 2.1 time: 0.136636 Aug 29 21:56:46.163535 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 431/861] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:45 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:46.163720 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 431/862] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:46 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1622 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:56:46.762580 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-4c1e46c8-1171-4322-914f-4fb308b74dd5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:46.764001 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-4c1e46c8-1171-4322-914f-4fb308b74dd5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:46.777215 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4c1e46c8-1171-4322-914f-4fb308b74dd5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:46.779321 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4c1e46c8-1171-4322-914f-4fb308b74dd5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:46.780691 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4c1e46c8-1171-4322-914f-4fb308b74dd5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:46.785604 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4c1e46c8-1171-4322-914f-4fb308b74dd5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:46.786374 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4c1e46c8-1171-4322-914f-4fb308b74dd5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:46.786981 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-4c1e46c8-1171-4322-914f-4fb308b74dd5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:47.011722 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4c1e46c8-1171-4322-914f-4fb308b74dd5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:47.028653 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4c1e46c8-1171-4322-914f-4fb308b74dd5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:47.030540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-4c1e46c8-1171-4322-914f-4fb308b74dd5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:47.032273 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-4c1e46c8-1171-4322-914f-4fb308b74dd5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1745 microversion: 2.20 time: 0.274037 Aug 29 21:56:47.036557 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 432/863] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:46 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1745 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:47.166196 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d3c1c39c-13f7-46b9-8b25-77270fb3a50e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:47.167647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d3c1c39c-13f7-46b9-8b25-77270fb3a50e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:47.172319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6e5e86a7-5377-4f4c-9a34-a0446f07c4e8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:47.173800 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-6e5e86a7-5377-4f4c-9a34-a0446f07c4e8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:47.175425 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d3c1c39c-13f7-46b9-8b25-77270fb3a50e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:47.176092 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d3c1c39c-13f7-46b9-8b25-77270fb3a50e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:47.176760 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d3c1c39c-13f7-46b9-8b25-77270fb3a50e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:47.178283 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d3c1c39c-13f7-46b9-8b25-77270fb3a50e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:47.178906 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d3c1c39c-13f7-46b9-8b25-77270fb3a50e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:47.179595 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d3c1c39c-13f7-46b9-8b25-77270fb3a50e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:47.184066 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6e5e86a7-5377-4f4c-9a34-a0446f07c4e8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:47.184826 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6e5e86a7-5377-4f4c-9a34-a0446f07c4e8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:47.190780 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6e5e86a7-5377-4f4c-9a34-a0446f07c4e8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:47.190780 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6e5e86a7-5377-4f4c-9a34-a0446f07c4e8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:47.190780 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6e5e86a7-5377-4f4c-9a34-a0446f07c4e8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:47.190780 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6e5e86a7-5377-4f4c-9a34-a0446f07c4e8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:47.274150 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d3c1c39c-13f7-46b9-8b25-77270fb3a50e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:47.289275 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d3c1c39c-13f7-46b9-8b25-77270fb3a50e tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1331 microversion: 2.1 time: 0.127303 Aug 29 21:56:47.290759 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 432/864] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:47 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1331 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:47.381220 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-6e5e86a7-5377-4f4c-9a34-a0446f07c4e8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:47.389858 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-6e5e86a7-5377-4f4c-9a34-a0446f07c4e8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.223011 Aug 29 21:56:47.390440 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 433/865] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:47 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:56:48.074036 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d8b38268-820f-4281-a84c-d2a19d595b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:48.074665 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d8b38268-820f-4281-a84c-d2a19d595b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:48.082783 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d8b38268-820f-4281-a84c-d2a19d595b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:48.083279 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d8b38268-820f-4281-a84c-d2a19d595b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:48.083872 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d8b38268-820f-4281-a84c-d2a19d595b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:48.084892 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d8b38268-820f-4281-a84c-d2a19d595b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:48.085418 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d8b38268-820f-4281-a84c-d2a19d595b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:48.085884 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d8b38268-820f-4281-a84c-d2a19d595b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:48.246761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d8b38268-820f-4281-a84c-d2a19d595b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:48.256022 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d8b38268-820f-4281-a84c-d2a19d595b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:48.259666 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d8b38268-820f-4281-a84c-d2a19d595b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:48.261161 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d8b38268-820f-4281-a84c-d2a19d595b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1740 microversion: 2.20 time: 0.191252 Aug 29 21:56:48.262003 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 433/866] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:48 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:48.313804 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0776cd18-383d-472f-84c7-786a5b696ae9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:48.323519 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-0776cd18-383d-472f-84c7-786a5b696ae9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:48.327716 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0776cd18-383d-472f-84c7-786a5b696ae9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:48.328260 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0776cd18-383d-472f-84c7-786a5b696ae9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:48.328689 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0776cd18-383d-472f-84c7-786a5b696ae9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:48.329444 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0776cd18-383d-472f-84c7-786a5b696ae9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:48.330090 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0776cd18-383d-472f-84c7-786a5b696ae9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:48.330533 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0776cd18-383d-472f-84c7-786a5b696ae9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:48.388833 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0776cd18-383d-472f-84c7-786a5b696ae9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:48.389656 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0776cd18-383d-472f-84c7-786a5b696ae9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:48.390275 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0776cd18-383d-472f-84c7-786a5b696ae9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:48.391475 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-0776cd18-383d-472f-84c7-786a5b696ae9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lazy-loading 'fault' on Instance uuid 945580b2-8dd8-43c7-a485-9501fd158032 {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:56:48.445439 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-0776cd18-383d-472f-84c7-786a5b696ae9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:48.454431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-0776cd18-383d-472f-84c7-786a5b696ae9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 200 len: 1336 microversion: 2.1 time: 0.145482 Aug 29 21:56:48.455844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 434/867] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:48 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 1336 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:48.461030 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-8f29b91b-368a-49f6-a0e0-3a9a31b4882d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:48.462019 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-8f29b91b-368a-49f6-a0e0-3a9a31b4882d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:48.468913 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8f29b91b-368a-49f6-a0e0-3a9a31b4882d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:48.469779 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8f29b91b-368a-49f6-a0e0-3a9a31b4882d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:48.470578 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8f29b91b-368a-49f6-a0e0-3a9a31b4882d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:48.471512 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8f29b91b-368a-49f6-a0e0-3a9a31b4882d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:48.471962 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8f29b91b-368a-49f6-a0e0-3a9a31b4882d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:48.472383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8f29b91b-368a-49f6-a0e0-3a9a31b4882d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:48.534114 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-89dd3857-12ac-401f-9453-d6d4dd73a986 req-d2b68599-dda2-41ae-8115-72733b9dbcba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01db998-129a-4b44-a3c4-1da1bf023620", "name": "network-vif-plugged", "status": "completed", "tag": "95ba8615-923a-46f1-ae70-f15459156d2b"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:56:48.550821 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-89dd3857-12ac-401f-9453-d6d4dd73a986 req-d2b68599-dda2-41ae-8115-72733b9dbcba service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:48.551315 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-89dd3857-12ac-401f-9453-d6d4dd73a986 req-d2b68599-dda2-41ae-8115-72733b9dbcba service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:48.551787 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-89dd3857-12ac-401f-9453-d6d4dd73a986 req-d2b68599-dda2-41ae-8115-72733b9dbcba service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:48.571655 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-89dd3857-12ac-401f-9453-d6d4dd73a986 req-d2b68599-dda2-41ae-8115-72733b9dbcba service nova] Creating event network-vif-plugged:95ba8615-923a-46f1-ae70-f15459156d2b for instance d01db998-129a-4b44-a3c4-1da1bf023620 on hv-cinder-85426 Aug 29 21:56:48.577635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-89dd3857-12ac-401f-9453-d6d4dd73a986 req-d2b68599-dda2-41ae-8115-72733b9dbcba service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211903 Aug 29 21:56:48.578262 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 434/868] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:56:48.669409 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-8f29b91b-368a-49f6-a0e0-3a9a31b4882d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:48.673603 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:48.682685 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-8f29b91b-368a-49f6-a0e0-3a9a31b4882d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.225475 Aug 29 21:56:48.697514 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 435/869] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:48 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:48.955081 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ed6ca08c-16ee-4658-8654-fa1ed9e68a66 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25f05140-2579-46b7-9bfd-74dc23887928"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:56:48.957838 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ed6ca08c-16ee-4658-8654-fa1ed9e68a66 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:48.969297 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ed6ca08c-16ee-4658-8654-fa1ed9e68a66 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:48.969791 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ed6ca08c-16ee-4658-8654-fa1ed9e68a66 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:48.970626 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ed6ca08c-16ee-4658-8654-fa1ed9e68a66 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:48.971351 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ed6ca08c-16ee-4658-8654-fa1ed9e68a66 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:48.971809 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ed6ca08c-16ee-4658-8654-fa1ed9e68a66 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:48.972238 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ed6ca08c-16ee-4658-8654-fa1ed9e68a66 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:49.290976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-99999a6a-d073-4e42-a477-1b66da0b1712 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:49.292097 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-99999a6a-d073-4e42-a477-1b66da0b1712 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:49.301133 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-99999a6a-d073-4e42-a477-1b66da0b1712 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:49.301871 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-99999a6a-d073-4e42-a477-1b66da0b1712 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:49.302576 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-99999a6a-d073-4e42-a477-1b66da0b1712 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:49.303436 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-99999a6a-d073-4e42-a477-1b66da0b1712 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:49.304074 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-99999a6a-d073-4e42-a477-1b66da0b1712 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:49.304713 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-99999a6a-d073-4e42-a477-1b66da0b1712 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:49.515507 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-99999a6a-d073-4e42-a477-1b66da0b1712 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:49.532886 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-99999a6a-d073-4e42-a477-1b66da0b1712 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:49.536806 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-99999a6a-d073-4e42-a477-1b66da0b1712 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:49.541661 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-99999a6a-d073-4e42-a477-1b66da0b1712 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1740 microversion: 2.20 time: 0.253311 Aug 29 21:56:49.542841 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 436/870] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:49 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:56:49.569313 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-776ac6f1-362c-47cb-bc15-1b6c19cfe395 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:49.570730 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-776ac6f1-362c-47cb-bc15-1b6c19cfe395 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 945580b2-8dd8-43c7-a485-9501fd158032] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:49.578434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-776ac6f1-362c-47cb-bc15-1b6c19cfe395 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:49.578951 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-776ac6f1-362c-47cb-bc15-1b6c19cfe395 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:49.579555 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-776ac6f1-362c-47cb-bc15-1b6c19cfe395 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:49.580263 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-776ac6f1-362c-47cb-bc15-1b6c19cfe395 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:49.580979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-776ac6f1-362c-47cb-bc15-1b6c19cfe395 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:49.581717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-776ac6f1-362c-47cb-bc15-1b6c19cfe395 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:49.602312 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-776ac6f1-362c-47cb-bc15-1b6c19cfe395 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] HTTP exception thrown: Instance 945580b2-8dd8-43c7-a485-9501fd158032 could not be found. Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-776ac6f1-362c-47cb-bc15-1b6c19cfe395 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Request method failure captured: Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 HTTP/1.1 Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTUBV54KXufTxPgBAlndN0DEguNRKzSRmEC5xewb2lPPOimeyFRSKSE-6O1bForpBT9-ggR6RsNJabRPmDZZQOEUgzIPpDU_UHM7JinN8BmN7CaDpBTpPmSAVaL8wDeAim5TRDVnE7RSL44Ykqa0DQF0eZupQ_CRNGNzjBu6MIoH0-w Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: f8ca070dc59e4a69bdaca0150f92bcc4 Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1630666147 Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:56:49.604109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:56:49.605781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:56:49.605781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1630666147 Aug 29 21:56:49.605781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: f8ca070dc59e4a69bdaca0150f92bcc4 Aug 29 21:56:49.605781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1630666147 Aug 29 21:56:49.605781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-ServerRescueNegativeTestJSON-1630666147-project Aug 29 21:56:49.605781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:56:49.605781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:56:49.605781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 3575098818954a949e202397a1b20a6a Aug 29 21:56:49.605781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1630666147-project Aug 29 21:56:49.605781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:56:49.605781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 945580b2-8dd8-43c7-a485-9501fd158032 could not be found. Aug 29 21:56:49.605781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '945580b2-8dd8-43c7-a485-9501fd158032'} Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 945580b2-8dd8-43c7-a485-9501fd158032 could not be found. Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:56:49.607547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 945580b2-8dd8-43c7-a485-9501fd158032 could not be found. Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 945580b2-8dd8-43c7-a485-9501fd158032 could not be found. Aug 29 21:56:49.617268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:56:49.618719 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-776ac6f1-362c-47cb-bc15-1b6c19cfe395 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Returning 404 to user: Instance 945580b2-8dd8-43c7-a485-9501fd158032 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:56:49.618719 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-776ac6f1-362c-47cb-bc15-1b6c19cfe395 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032" status: 404 len: 111 microversion: 2.1 time: 0.066028 Aug 29 21:56:49.618719 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 437/871] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:49 2022] GET /compute/v2.1/servers/945580b2-8dd8-43c7-a485-9501fd158032 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:56:49.621319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-39cba77a-7486-4122-8e28-b84aa479716d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '.version_select at 0x7f50406e19d0>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:49.711135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-39cba77a-7486-4122-8e28-b84aa479716d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011664555" status: 202 len: 0 microversion: 2.1 time: 0.093740 Aug 29 21:56:49.711637 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 438/872] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 21:56:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011664555 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:56:49.726886 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c3da4686-4a8d-450b-a4c6-f8a03a5b4037 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:49.727558 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c3da4686-4a8d-450b-a4c6-f8a03a5b4037 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:49.734532 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c3da4686-4a8d-450b-a4c6-f8a03a5b4037 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:49.738135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c3da4686-4a8d-450b-a4c6-f8a03a5b4037 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:49.739159 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c3da4686-4a8d-450b-a4c6-f8a03a5b4037 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:49.741207 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c3da4686-4a8d-450b-a4c6-f8a03a5b4037 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:49.741880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c3da4686-4a8d-450b-a4c6-f8a03a5b4037 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:49.742546 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c3da4686-4a8d-450b-a4c6-f8a03a5b4037 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:50.067314 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ed6ca08c-16ee-4658-8654-fa1ed9e68a66 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "POST /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.116498 Aug 29 21:56:50.070908 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 435/873] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 21:56:48 2022] POST /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments => generated 194 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:56:50.090314 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c3da4686-4a8d-450b-a4c6-f8a03a5b4037 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:50.105416 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c3da4686-4a8d-450b-a4c6-f8a03a5b4037 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1512 microversion: 2.1 time: 0.390192 Aug 29 21:56:50.105416 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 439/874] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:49 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1512 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:50.127496 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-be757260-2f1b-4f2d-8e3d-704b72d1cde8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:56:50.127921 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-be757260-2f1b-4f2d-8e3d-704b72d1cde8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:50.138289 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be757260-2f1b-4f2d-8e3d-704b72d1cde8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:50.138801 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be757260-2f1b-4f2d-8e3d-704b72d1cde8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:50.139247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be757260-2f1b-4f2d-8e3d-704b72d1cde8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:50.150019 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be757260-2f1b-4f2d-8e3d-704b72d1cde8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:50.150917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be757260-2f1b-4f2d-8e3d-704b72d1cde8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:50.151628 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be757260-2f1b-4f2d-8e3d-704b72d1cde8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:50.217412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-be757260-2f1b-4f2d-8e3d-704b72d1cde8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127883) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 21:56:50.360290 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:50.573326 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5b90b7c6-1402-4659-b39e-93b086b0f772 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:50.574750 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5b90b7c6-1402-4659-b39e-93b086b0f772 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:50.576788 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-be757260-2f1b-4f2d-8e3d-704b72d1cde8 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "POST /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f/action" status: 202 len: 0 microversion: 2.1 time: 0.454477 Aug 29 21:56:50.582621 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 436/875] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 21:56:50 2022] POST /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:56:50.591329 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5b90b7c6-1402-4659-b39e-93b086b0f772 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:50.593219 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5b90b7c6-1402-4659-b39e-93b086b0f772 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:50.593889 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5b90b7c6-1402-4659-b39e-93b086b0f772 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:50.595425 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5b90b7c6-1402-4659-b39e-93b086b0f772 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:50.596085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5b90b7c6-1402-4659-b39e-93b086b0f772 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:50.596743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5b90b7c6-1402-4659-b39e-93b086b0f772 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:50.597097 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f1648fb8-5973-4a1f-94c4-c68636ee44d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:50.598718 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f1648fb8-5973-4a1f-94c4-c68636ee44d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:50.614510 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f1648fb8-5973-4a1f-94c4-c68636ee44d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:50.615730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f1648fb8-5973-4a1f-94c4-c68636ee44d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:50.616619 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f1648fb8-5973-4a1f-94c4-c68636ee44d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:50.617645 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f1648fb8-5973-4a1f-94c4-c68636ee44d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:50.618274 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f1648fb8-5973-4a1f-94c4-c68636ee44d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:50.619002 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f1648fb8-5973-4a1f-94c4-c68636ee44d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:50.828837 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5b90b7c6-1402-4659-b39e-93b086b0f772 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:50.846799 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5b90b7c6-1402-4659-b39e-93b086b0f772 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:50.848781 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5b90b7c6-1402-4659-b39e-93b086b0f772 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:50.851577 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5b90b7c6-1402-4659-b39e-93b086b0f772 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1740 microversion: 2.20 time: 0.287838 Aug 29 21:56:50.852812 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 440/876] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:50 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:50.858691 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-5736f410-dbab-45a8-95a1-b89e51c8f501 req-ada3dbb6-cde0-401b-8789-b8051b860307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90c4eb2-99e9-4c0f-9336-0ecd87390a9f", "name": "network-vif-unplugged", "status": "completed", "tag": "245c7474-204e-46f8-a4ef-735e7fa0f46e"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:56:50.889315 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-5736f410-dbab-45a8-95a1-b89e51c8f501 req-ada3dbb6-cde0-401b-8789-b8051b860307 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:50.889874 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-5736f410-dbab-45a8-95a1-b89e51c8f501 req-ada3dbb6-cde0-401b-8789-b8051b860307 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:50.890551 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-5736f410-dbab-45a8-95a1-b89e51c8f501 req-ada3dbb6-cde0-401b-8789-b8051b860307 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:50.901231 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f1648fb8-5973-4a1f-94c4-c68636ee44d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:50.906587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.compute.server_external_events [req-5736f410-dbab-45a8-95a1-b89e51c8f501 req-ada3dbb6-cde0-401b-8789-b8051b860307 service nova] Unable to find a host for instance b90c4eb2-99e9-4c0f-9336-0ecd87390a9f. Dropping event network-vif-unplugged {{(pid=127882) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 21:56:50.908003 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-5736f410-dbab-45a8-95a1-b89e51c8f501 req-ada3dbb6-cde0-401b-8789-b8051b860307 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053728 Aug 29 21:56:50.908950 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 441/877] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 21:56:50.921702 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f1648fb8-5973-4a1f-94c4-c68636ee44d3 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1520 microversion: 2.1 time: 0.335611 Aug 29 21:56:50.923089 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 437/878] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:50 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:56:51.883112 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-db085f70-42ee-48d9-8eb2-a901f18b8896 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:51.884083 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-db085f70-42ee-48d9-8eb2-a901f18b8896 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:51.908942 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db085f70-42ee-48d9-8eb2-a901f18b8896 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:51.911777 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db085f70-42ee-48d9-8eb2-a901f18b8896 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:51.911777 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db085f70-42ee-48d9-8eb2-a901f18b8896 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:51.913552 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db085f70-42ee-48d9-8eb2-a901f18b8896 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:51.914301 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db085f70-42ee-48d9-8eb2-a901f18b8896 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:51.915005 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db085f70-42ee-48d9-8eb2-a901f18b8896 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:51.960764 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7837d9ff-fc61-44ea-9b60-33b0d1b81a5f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:51.962420 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7837d9ff-fc61-44ea-9b60-33b0d1b81a5f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:51.982087 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7837d9ff-fc61-44ea-9b60-33b0d1b81a5f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:51.983238 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7837d9ff-fc61-44ea-9b60-33b0d1b81a5f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:51.985654 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7837d9ff-fc61-44ea-9b60-33b0d1b81a5f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:51.989647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7837d9ff-fc61-44ea-9b60-33b0d1b81a5f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:51.991122 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7837d9ff-fc61-44ea-9b60-33b0d1b81a5f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:51.994550 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7837d9ff-fc61-44ea-9b60-33b0d1b81a5f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:52.147894 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-db085f70-42ee-48d9-8eb2-a901f18b8896 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:52.169267 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-db085f70-42ee-48d9-8eb2-a901f18b8896 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:52.171413 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-db085f70-42ee-48d9-8eb2-a901f18b8896 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:52.173170 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-db085f70-42ee-48d9-8eb2-a901f18b8896 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1740 microversion: 2.20 time: 0.298799 Aug 29 21:56:52.174569 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 442/879] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:51 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1740 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:52.219701 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7837d9ff-fc61-44ea-9b60-33b0d1b81a5f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:52.229686 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7837d9ff-fc61-44ea-9b60-33b0d1b81a5f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1520 microversion: 2.1 time: 0.278532 Aug 29 21:56:52.230290 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 438/880] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:51 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:53.200322 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-7e83e70e-cd90-46ed-b422-479e4e0da313 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:53.201873 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-7e83e70e-cd90-46ed-b422-479e4e0da313 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:53.216252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7e83e70e-cd90-46ed-b422-479e4e0da313 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:53.216788 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7e83e70e-cd90-46ed-b422-479e4e0da313 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:53.217226 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7e83e70e-cd90-46ed-b422-479e4e0da313 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:53.218320 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7e83e70e-cd90-46ed-b422-479e4e0da313 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:53.219116 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7e83e70e-cd90-46ed-b422-479e4e0da313 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:53.219551 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7e83e70e-cd90-46ed-b422-479e4e0da313 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:53.252819 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6e252acf-05a8-481f-81a5-cebf8edb06d6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:53.253657 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6e252acf-05a8-481f-81a5-cebf8edb06d6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:53.265886 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e252acf-05a8-481f-81a5-cebf8edb06d6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:53.266384 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e252acf-05a8-481f-81a5-cebf8edb06d6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:53.269697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e252acf-05a8-481f-81a5-cebf8edb06d6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:53.272214 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e252acf-05a8-481f-81a5-cebf8edb06d6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:53.273069 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e252acf-05a8-481f-81a5-cebf8edb06d6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:53.273553 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6e252acf-05a8-481f-81a5-cebf8edb06d6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:53.477884 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-7e83e70e-cd90-46ed-b422-479e4e0da313 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:53.495672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-7e83e70e-cd90-46ed-b422-479e4e0da313 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:53.497616 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-7e83e70e-cd90-46ed-b422-479e4e0da313 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:53.514381 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-7e83e70e-cd90-46ed-b422-479e4e0da313 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1740 microversion: 2.20 time: 0.306274 Aug 29 21:56:53.514381 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 443/881] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:53 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:53.562902 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6e252acf-05a8-481f-81a5-cebf8edb06d6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:53.588772 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6e252acf-05a8-481f-81a5-cebf8edb06d6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1520 microversion: 2.1 time: 0.340767 Aug 29 21:56:53.590569 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 439/882] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:53 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:56:53.625299 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9917329e-ac8c-49be-9df2-78f527f3e382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:53.627762 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9917329e-ac8c-49be-9df2-78f527f3e382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:53.635498 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9917329e-ac8c-49be-9df2-78f527f3e382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:53.636009 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9917329e-ac8c-49be-9df2-78f527f3e382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:53.636569 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9917329e-ac8c-49be-9df2-78f527f3e382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:53.637587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9917329e-ac8c-49be-9df2-78f527f3e382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:53.638281 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9917329e-ac8c-49be-9df2-78f527f3e382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:53.638880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9917329e-ac8c-49be-9df2-78f527f3e382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:53.688341 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9917329e-ac8c-49be-9df2-78f527f3e382 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068212 Aug 29 21:56:53.689477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 444/883] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 21:56:53 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:56:53.713259 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-77571b30-f34a-4133-bdd7-b81c762754ba tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:53.714636 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-77571b30-f34a-4133-bdd7-b81c762754ba tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:53.727095 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-77571b30-f34a-4133-bdd7-b81c762754ba tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:53.728424 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-77571b30-f34a-4133-bdd7-b81c762754ba tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:53.729537 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-77571b30-f34a-4133-bdd7-b81c762754ba tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:53.730882 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-77571b30-f34a-4133-bdd7-b81c762754ba tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:53.731765 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-77571b30-f34a-4133-bdd7-b81c762754ba tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:53.732598 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-77571b30-f34a-4133-bdd7-b81c762754ba tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:53.808282 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-77571b30-f34a-4133-bdd7-b81c762754ba tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments/25f05140-2579-46b7-9bfd-74dc23887928" status: 200 len: 194 microversion: 2.1 time: 0.107248 Aug 29 21:56:53.809459 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 440/884] 10.222.0.83 () {58 vars in 1413 bytes} [Mon Aug 29 21:56:53 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments/25f05140-2579-46b7-9bfd-74dc23887928 => generated 194 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:56:54.219937 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6a3df57d-95f3-476a-8be2-9b2143c0f627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:54.221138 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-6a3df57d-95f3-476a-8be2-9b2143c0f627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:54.230648 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6a3df57d-95f3-476a-8be2-9b2143c0f627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:54.231443 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6a3df57d-95f3-476a-8be2-9b2143c0f627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:54.233056 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6a3df57d-95f3-476a-8be2-9b2143c0f627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:54.234057 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6a3df57d-95f3-476a-8be2-9b2143c0f627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:54.234533 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6a3df57d-95f3-476a-8be2-9b2143c0f627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:54.235125 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6a3df57d-95f3-476a-8be2-9b2143c0f627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:54.289626 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-6a3df57d-95f3-476a-8be2-9b2143c0f627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Going to try to terminate instance {{(pid=127882) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:56:54.539165 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6474380a-c571-483c-be92-efbc192cb91c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:54.540551 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6474380a-c571-483c-be92-efbc192cb91c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:54.558037 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6474380a-c571-483c-be92-efbc192cb91c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:54.560611 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6474380a-c571-483c-be92-efbc192cb91c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:54.562185 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6474380a-c571-483c-be92-efbc192cb91c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:54.563970 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6474380a-c571-483c-be92-efbc192cb91c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:54.565854 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6474380a-c571-483c-be92-efbc192cb91c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:54.566477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6474380a-c571-483c-be92-efbc192cb91c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:54.636961 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-6a3df57d-95f3-476a-8be2-9b2143c0f627 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "DELETE /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 204 len: 0 microversion: 2.1 time: 0.435755 Aug 29 21:56:54.638753 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 445/885] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:56:54 2022] DELETE /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 21:56:54.661196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-01c5e99a-8166-43c7-990c-36e83534bf20 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:54.668770 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-01c5e99a-8166-43c7-990c-36e83534bf20 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:54.695991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01c5e99a-8166-43c7-990c-36e83534bf20 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:54.707627 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01c5e99a-8166-43c7-990c-36e83534bf20 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:54.708373 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01c5e99a-8166-43c7-990c-36e83534bf20 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:54.711408 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01c5e99a-8166-43c7-990c-36e83534bf20 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:54.719703 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01c5e99a-8166-43c7-990c-36e83534bf20 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:54.723215 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-01c5e99a-8166-43c7-990c-36e83534bf20 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:54.936571 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6474380a-c571-483c-be92-efbc192cb91c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:54.956234 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6474380a-c571-483c-be92-efbc192cb91c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:54.958853 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-6474380a-c571-483c-be92-efbc192cb91c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:54.961345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6474380a-c571-483c-be92-efbc192cb91c tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1740 microversion: 2.20 time: 0.426690 Aug 29 21:56:54.962645 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 441/886] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:54 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1740 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:54.969824 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-71a8d1f7-07e6-4ad3-921a-e0c24f250a68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:54.970865 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-71a8d1f7-07e6-4ad3-921a-e0c24f250a68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:54.980402 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-71a8d1f7-07e6-4ad3-921a-e0c24f250a68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:54.981632 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-71a8d1f7-07e6-4ad3-921a-e0c24f250a68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:54.982444 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-71a8d1f7-07e6-4ad3-921a-e0c24f250a68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:54.983761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-71a8d1f7-07e6-4ad3-921a-e0c24f250a68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:54.984598 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-71a8d1f7-07e6-4ad3-921a-e0c24f250a68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:54.985328 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-71a8d1f7-07e6-4ad3-921a-e0c24f250a68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:55.170368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-71a8d1f7-07e6-4ad3-921a-e0c24f250a68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:55.182510 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-71a8d1f7-07e6-4ad3-921a-e0c24f250a68 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1507 microversion: 2.1 time: 0.218343 Aug 29 21:56:55.183364 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 442/887] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:54 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:55.216064 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-01c5e99a-8166-43c7-990c-36e83534bf20 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:55.234994 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-01c5e99a-8166-43c7-990c-36e83534bf20 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1522 microversion: 2.1 time: 0.593312 Aug 29 21:56:55.237981 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 446/888] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:54 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1522 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:55.830270 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-c2e0b50e-9c0b-4c5f-b34a-4866becaebae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd4580cb-c9e0-477e-b07d-635c80cec8b7"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:56:55.836165 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-c2e0b50e-9c0b-4c5f-b34a-4866becaebae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:55.848670 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c2e0b50e-9c0b-4c5f-b34a-4866becaebae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:55.852616 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c2e0b50e-9c0b-4c5f-b34a-4866becaebae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:55.852616 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c2e0b50e-9c0b-4c5f-b34a-4866becaebae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:55.852616 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c2e0b50e-9c0b-4c5f-b34a-4866becaebae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:55.854029 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c2e0b50e-9c0b-4c5f-b34a-4866becaebae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:55.855053 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c2e0b50e-9c0b-4c5f-b34a-4866becaebae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:55.994719 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-984e3301-d38f-47c8-a4c4-4280e93b3a0d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:55.996352 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-984e3301-d38f-47c8-a4c4-4280e93b3a0d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:56.011888 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-984e3301-d38f-47c8-a4c4-4280e93b3a0d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:56.014326 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-984e3301-d38f-47c8-a4c4-4280e93b3a0d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:56.015368 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-984e3301-d38f-47c8-a4c4-4280e93b3a0d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:56.017092 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-984e3301-d38f-47c8-a4c4-4280e93b3a0d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:56.018207 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-984e3301-d38f-47c8-a4c4-4280e93b3a0d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:56.019200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-984e3301-d38f-47c8-a4c4-4280e93b3a0d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:56.273504 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-984e3301-d38f-47c8-a4c4-4280e93b3a0d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:56.284984 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-984e3301-d38f-47c8-a4c4-4280e93b3a0d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:56.288405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-984e3301-d38f-47c8-a4c4-4280e93b3a0d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:56.288405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-984e3301-d38f-47c8-a4c4-4280e93b3a0d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1740 microversion: 2.20 time: 0.301789 Aug 29 21:56:56.288799 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 447/889] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:55 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1740 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:56.293229 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-fda26faf-88c4-4fa8-a731-2eec6b7200c1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:56.293847 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-fda26faf-88c4-4fa8-a731-2eec6b7200c1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:56.301288 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fda26faf-88c4-4fa8-a731-2eec6b7200c1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:56.302147 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fda26faf-88c4-4fa8-a731-2eec6b7200c1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:56.303311 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fda26faf-88c4-4fa8-a731-2eec6b7200c1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:56.304415 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fda26faf-88c4-4fa8-a731-2eec6b7200c1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:56.305106 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fda26faf-88c4-4fa8-a731-2eec6b7200c1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:56.305547 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-fda26faf-88c4-4fa8-a731-2eec6b7200c1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:56.488329 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-fda26faf-88c4-4fa8-a731-2eec6b7200c1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:56.497624 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-fda26faf-88c4-4fa8-a731-2eec6b7200c1 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1507 microversion: 2.1 time: 0.208064 Aug 29 21:56:56.498207 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 448/890] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:56 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1507 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:56.502725 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e027c056-8e9f-4130-8aab-23970ba386f9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:56.503325 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-e027c056-8e9f-4130-8aab-23970ba386f9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:56.510115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e027c056-8e9f-4130-8aab-23970ba386f9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:56.510601 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e027c056-8e9f-4130-8aab-23970ba386f9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:56.511036 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e027c056-8e9f-4130-8aab-23970ba386f9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:56.511729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e027c056-8e9f-4130-8aab-23970ba386f9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:56.512175 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e027c056-8e9f-4130-8aab-23970ba386f9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:56.512637 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e027c056-8e9f-4130-8aab-23970ba386f9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:56.664459 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e027c056-8e9f-4130-8aab-23970ba386f9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:56.674329 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e027c056-8e9f-4130-8aab-23970ba386f9 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1522 microversion: 2.1 time: 0.174621 Aug 29 21:56:56.674901 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 449/891] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:56 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:57.312726 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-bdc42349-677c-4f85-895c-64f0e372be72 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:57.314248 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-bdc42349-677c-4f85-895c-64f0e372be72 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:57.330809 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bdc42349-677c-4f85-895c-64f0e372be72 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:57.335935 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bdc42349-677c-4f85-895c-64f0e372be72 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:57.336742 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bdc42349-677c-4f85-895c-64f0e372be72 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:57.338052 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bdc42349-677c-4f85-895c-64f0e372be72 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:57.338814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bdc42349-677c-4f85-895c-64f0e372be72 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:57.345913 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bdc42349-677c-4f85-895c-64f0e372be72 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:57.609712 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-bdc42349-677c-4f85-895c-64f0e372be72 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:57.619564 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-bdc42349-677c-4f85-895c-64f0e372be72 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:57.621791 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-bdc42349-677c-4f85-895c-64f0e372be72 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:57.623185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-bdc42349-677c-4f85-895c-64f0e372be72 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1740 microversion: 2.20 time: 0.315336 Aug 29 21:56:57.628878 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 450/892] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:57 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1740 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:57.634811 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-8dad88fa-aec9-4690-a3cb-5c9d5e511dfb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:57.651126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-8dad88fa-aec9-4690-a3cb-5c9d5e511dfb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:57.651126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8dad88fa-aec9-4690-a3cb-5c9d5e511dfb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:57.651126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8dad88fa-aec9-4690-a3cb-5c9d5e511dfb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:57.651126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8dad88fa-aec9-4690-a3cb-5c9d5e511dfb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:57.651830 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8dad88fa-aec9-4690-a3cb-5c9d5e511dfb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:57.651830 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8dad88fa-aec9-4690-a3cb-5c9d5e511dfb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:57.651830 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8dad88fa-aec9-4690-a3cb-5c9d5e511dfb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:57.838169 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-c2e0b50e-9c0b-4c5f-b34a-4866becaebae tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "POST /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.015064 Aug 29 21:56:57.842960 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 443/893] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 21:56:55 2022] POST /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments => generated 194 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:56:57.851568 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-8dad88fa-aec9-4690-a3cb-5c9d5e511dfb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:57.857970 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-3e129967-7bee-44a2-9cf9-0ebb1df6cb03 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:57.858993 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-3e129967-7bee-44a2-9cf9-0ebb1df6cb03 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:57.863341 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-8dad88fa-aec9-4690-a3cb-5c9d5e511dfb tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1507 microversion: 2.1 time: 0.232948 Aug 29 21:56:57.864282 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 451/894] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:57 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:57.870891 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3e129967-7bee-44a2-9cf9-0ebb1df6cb03 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:57.871743 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3e129967-7bee-44a2-9cf9-0ebb1df6cb03 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:57.872596 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3e129967-7bee-44a2-9cf9-0ebb1df6cb03 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:57.873730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3e129967-7bee-44a2-9cf9-0ebb1df6cb03 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:57.874360 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3e129967-7bee-44a2-9cf9-0ebb1df6cb03 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:57.874957 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3e129967-7bee-44a2-9cf9-0ebb1df6cb03 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:58.141019 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-3e129967-7bee-44a2-9cf9-0ebb1df6cb03 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:58.160584 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-33adf6cc-cc1e-4acb-a327-9b37353efe5d req-e42336d0-b477-4ce2-8582-58b90314186b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be8351b-602c-427c-915a-c0edd27cbfaf", "name": "network-vif-deleted", "tag": "6e0d683b-55a7-46c5-b0b3-47db84b3a9a3"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:56:58.164177 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-3e129967-7bee-44a2-9cf9-0ebb1df6cb03 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1578 microversion: 2.1 time: 0.307622 Aug 29 21:56:58.177229 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-33adf6cc-cc1e-4acb-a327-9b37353efe5d req-e42336d0-b477-4ce2-8582-58b90314186b service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:58.177756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-33adf6cc-cc1e-4acb-a327-9b37353efe5d req-e42336d0-b477-4ce2-8582-58b90314186b service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:58.182679 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-33adf6cc-cc1e-4acb-a327-9b37353efe5d req-e42336d0-b477-4ce2-8582-58b90314186b service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:58.183460 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 444/895] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:57 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1578 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:56:58.206786 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-33adf6cc-cc1e-4acb-a327-9b37353efe5d req-e42336d0-b477-4ce2-8582-58b90314186b service nova] Creating event network-vif-deleted:6e0d683b-55a7-46c5-b0b3-47db84b3a9a3 for instance 1be8351b-602c-427c-915a-c0edd27cbfaf on hv-cinder-85426 Aug 29 21:56:58.218292 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-33adf6cc-cc1e-4acb-a327-9b37353efe5d req-e42336d0-b477-4ce2-8582-58b90314186b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061070 Aug 29 21:56:58.218936 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 452/896] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:56:58.647282 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-0c73bf9c-6c48-47fd-b18d-e03c6ac13016 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:58.649757 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-0c73bf9c-6c48-47fd-b18d-e03c6ac13016 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:58.662460 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0c73bf9c-6c48-47fd-b18d-e03c6ac13016 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:58.662981 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0c73bf9c-6c48-47fd-b18d-e03c6ac13016 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:58.663622 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0c73bf9c-6c48-47fd-b18d-e03c6ac13016 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:58.664622 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0c73bf9c-6c48-47fd-b18d-e03c6ac13016 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:58.665276 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0c73bf9c-6c48-47fd-b18d-e03c6ac13016 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:58.666364 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-0c73bf9c-6c48-47fd-b18d-e03c6ac13016 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:58.892736 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b5e53258-e02f-4f9a-a4cd-f959b8d44826 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:58.893577 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b5e53258-e02f-4f9a-a4cd-f959b8d44826 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:58.913112 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5e53258-e02f-4f9a-a4cd-f959b8d44826 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:58.913112 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5e53258-e02f-4f9a-a4cd-f959b8d44826 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:58.913112 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5e53258-e02f-4f9a-a4cd-f959b8d44826 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:58.914304 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5e53258-e02f-4f9a-a4cd-f959b8d44826 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:58.921060 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5e53258-e02f-4f9a-a4cd-f959b8d44826 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:58.923908 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5e53258-e02f-4f9a-a4cd-f959b8d44826 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:58.936867 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0c73bf9c-6c48-47fd-b18d-e03c6ac13016 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:58.971936 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5e53258-e02f-4f9a-a4cd-f959b8d44826 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:58.972743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5e53258-e02f-4f9a-a4cd-f959b8d44826 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:58.973373 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b5e53258-e02f-4f9a-a4cd-f959b8d44826 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:58.974007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-b5e53258-e02f-4f9a-a4cd-f959b8d44826 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lazy-loading 'fault' on Instance uuid 1be8351b-602c-427c-915a-c0edd27cbfaf {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:56:58.978167 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:58.981327 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0c73bf9c-6c48-47fd-b18d-e03c6ac13016 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:58.992808 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-0c73bf9c-6c48-47fd-b18d-e03c6ac13016 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:58.995683 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-0c73bf9c-6c48-47fd-b18d-e03c6ac13016 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1740 microversion: 2.20 time: 0.351966 Aug 29 21:56:59.024517 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 445/897] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:56:58 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1740 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:56:59.039370 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b5e53258-e02f-4f9a-a4cd-f959b8d44826 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:59.049673 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b5e53258-e02f-4f9a-a4cd-f959b8d44826 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1312 microversion: 2.1 time: 0.161765 Aug 29 21:56:59.050498 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 453/898] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:58 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:56:59.190239 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4089e72f-3148-4878-8ac4-7a1ed1483cfe tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:56:59.190807 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4089e72f-3148-4878-8ac4-7a1ed1483cfe tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:56:59.197956 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4089e72f-3148-4878-8ac4-7a1ed1483cfe tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:59.198442 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4089e72f-3148-4878-8ac4-7a1ed1483cfe tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:59.198908 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4089e72f-3148-4878-8ac4-7a1ed1483cfe tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:59.199611 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4089e72f-3148-4878-8ac4-7a1ed1483cfe tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:56:59.200128 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4089e72f-3148-4878-8ac4-7a1ed1483cfe tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:56:59.200579 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4089e72f-3148-4878-8ac4-7a1ed1483cfe tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:56:59.449494 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4089e72f-3148-4878-8ac4-7a1ed1483cfe tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:56:59.457012 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4089e72f-3148-4878-8ac4-7a1ed1483cfe tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1578 microversion: 2.1 time: 0.270961 Aug 29 21:56:59.471731 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 446/899] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:56:59 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1578 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:57:00.038725 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-27bed429-ea70-40c4-80ab-3ffbc794e845 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:00.039638 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-27bed429-ea70-40c4-80ab-3ffbc794e845 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:00.046961 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-27bed429-ea70-40c4-80ab-3ffbc794e845 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:00.047762 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-27bed429-ea70-40c4-80ab-3ffbc794e845 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:00.049319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-27bed429-ea70-40c4-80ab-3ffbc794e845 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:00.053421 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-27bed429-ea70-40c4-80ab-3ffbc794e845 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:00.054393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-27bed429-ea70-40c4-80ab-3ffbc794e845 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:00.055055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-27bed429-ea70-40c4-80ab-3ffbc794e845 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:00.080352 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-fac606c2-9c30-4873-a95d-e37bc59bd57d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:00.081223 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-fac606c2-9c30-4873-a95d-e37bc59bd57d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:00.089172 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fac606c2-9c30-4873-a95d-e37bc59bd57d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:00.089982 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fac606c2-9c30-4873-a95d-e37bc59bd57d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:00.090712 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fac606c2-9c30-4873-a95d-e37bc59bd57d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:00.092437 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fac606c2-9c30-4873-a95d-e37bc59bd57d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:00.097214 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fac606c2-9c30-4873-a95d-e37bc59bd57d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:00.098747 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fac606c2-9c30-4873-a95d-e37bc59bd57d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:00.148156 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fac606c2-9c30-4873-a95d-e37bc59bd57d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:00.149178 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fac606c2-9c30-4873-a95d-e37bc59bd57d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:00.149906 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fac606c2-9c30-4873-a95d-e37bc59bd57d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:00.150878 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-fac606c2-9c30-4873-a95d-e37bc59bd57d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lazy-loading 'fault' on Instance uuid 1be8351b-602c-427c-915a-c0edd27cbfaf {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:57:00.230685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-fac606c2-9c30-4873-a95d-e37bc59bd57d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:00.245473 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-fac606c2-9c30-4873-a95d-e37bc59bd57d tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1312 microversion: 2.1 time: 0.169561 Aug 29 21:57:00.250210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 447/900] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:00 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:57:00.291429 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-27bed429-ea70-40c4-80ab-3ffbc794e845 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:00.317043 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-27bed429-ea70-40c4-80ab-3ffbc794e845 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:00.324240 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-27bed429-ea70-40c4-80ab-3ffbc794e845 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:00.326360 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-27bed429-ea70-40c4-80ab-3ffbc794e845 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1740 microversion: 2.20 time: 0.292706 Aug 29 21:57:00.327164 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 454/901] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:00 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1740 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:00.479020 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-2dfcc288-4184-411d-be4d-5d0b71c6365f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:00.479640 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-2dfcc288-4184-411d-be4d-5d0b71c6365f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:00.499618 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2dfcc288-4184-411d-be4d-5d0b71c6365f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:00.500642 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2dfcc288-4184-411d-be4d-5d0b71c6365f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:00.501508 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2dfcc288-4184-411d-be4d-5d0b71c6365f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:00.502858 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2dfcc288-4184-411d-be4d-5d0b71c6365f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:00.503971 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2dfcc288-4184-411d-be4d-5d0b71c6365f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:00.504811 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-2dfcc288-4184-411d-be4d-5d0b71c6365f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:00.882709 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-2dfcc288-4184-411d-be4d-5d0b71c6365f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:00.894462 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-2dfcc288-4184-411d-be4d-5d0b71c6365f tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1578 microversion: 2.1 time: 0.419709 Aug 29 21:57:00.895329 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 448/902] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:00 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1578 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:57:01.272212 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f184ea6e-dfc7-4518-a04d-5105e94d0e8a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:01.273351 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f184ea6e-dfc7-4518-a04d-5105e94d0e8a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:01.282270 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f184ea6e-dfc7-4518-a04d-5105e94d0e8a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:01.282878 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f184ea6e-dfc7-4518-a04d-5105e94d0e8a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:01.283295 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f184ea6e-dfc7-4518-a04d-5105e94d0e8a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:01.284036 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f184ea6e-dfc7-4518-a04d-5105e94d0e8a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:01.284518 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f184ea6e-dfc7-4518-a04d-5105e94d0e8a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:01.284972 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f184ea6e-dfc7-4518-a04d-5105e94d0e8a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:01.326153 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f184ea6e-dfc7-4518-a04d-5105e94d0e8a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:01.326641 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f184ea6e-dfc7-4518-a04d-5105e94d0e8a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:01.327082 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f184ea6e-dfc7-4518-a04d-5105e94d0e8a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:01.327531 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-f184ea6e-dfc7-4518-a04d-5105e94d0e8a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lazy-loading 'fault' on Instance uuid 1be8351b-602c-427c-915a-c0edd27cbfaf {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:57:01.361691 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-87f88e6d-d6c0-479d-b5b8-40d757fcf901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:01.362460 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-87f88e6d-d6c0-479d-b5b8-40d757fcf901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:01.369776 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87f88e6d-d6c0-479d-b5b8-40d757fcf901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:01.369932 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87f88e6d-d6c0-479d-b5b8-40d757fcf901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:01.370296 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87f88e6d-d6c0-479d-b5b8-40d757fcf901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:01.371037 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87f88e6d-d6c0-479d-b5b8-40d757fcf901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:01.371490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87f88e6d-d6c0-479d-b5b8-40d757fcf901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:01.371918 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87f88e6d-d6c0-479d-b5b8-40d757fcf901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:01.373990 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f184ea6e-dfc7-4518-a04d-5105e94d0e8a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:01.385747 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f184ea6e-dfc7-4518-a04d-5105e94d0e8a tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 200 len: 1312 microversion: 2.1 time: 0.119037 Aug 29 21:57:01.386918 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 455/903] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:01 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:01.565654 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-87f88e6d-d6c0-479d-b5b8-40d757fcf901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:01.575157 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-87f88e6d-d6c0-479d-b5b8-40d757fcf901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:01.576662 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-87f88e6d-d6c0-479d-b5b8-40d757fcf901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:01.577902 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-87f88e6d-d6c0-479d-b5b8-40d757fcf901 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1740 microversion: 2.20 time: 0.220784 Aug 29 21:57:01.578461 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 449/904] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:01 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:01.928362 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2eefca34-872a-40e2-9cbe-ceaf091dd923 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:01.929395 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2eefca34-872a-40e2-9cbe-ceaf091dd923 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:01.936159 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2eefca34-872a-40e2-9cbe-ceaf091dd923 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:01.936696 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2eefca34-872a-40e2-9cbe-ceaf091dd923 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:01.937135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2eefca34-872a-40e2-9cbe-ceaf091dd923 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:01.937846 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2eefca34-872a-40e2-9cbe-ceaf091dd923 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:01.938295 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2eefca34-872a-40e2-9cbe-ceaf091dd923 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:01.938746 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2eefca34-872a-40e2-9cbe-ceaf091dd923 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:02.189089 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-2eefca34-872a-40e2-9cbe-ceaf091dd923 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:02.210020 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2eefca34-872a-40e2-9cbe-ceaf091dd923 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1578 microversion: 2.1 time: 0.285595 Aug 29 21:57:02.211156 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 456/905] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:01 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1578 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:57:02.510893 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b82782b7-3e78-4d15-905a-254182705c47 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:02.514067 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b82782b7-3e78-4d15-905a-254182705c47 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:02.527083 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b82782b7-3e78-4d15-905a-254182705c47 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:02.527961 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b82782b7-3e78-4d15-905a-254182705c47 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:02.528847 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b82782b7-3e78-4d15-905a-254182705c47 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:02.530487 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b82782b7-3e78-4d15-905a-254182705c47 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:02.531295 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b82782b7-3e78-4d15-905a-254182705c47 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:02.532045 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b82782b7-3e78-4d15-905a-254182705c47 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:02.571345 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b82782b7-3e78-4d15-905a-254182705c47 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.065674 Aug 29 21:57:02.571895 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 457/906] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 21:57:02 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments => generated 371 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:57:02.602161 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d210e522-8d9f-4e42-9d57-1b7f4aeaa173 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:02.602765 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d210e522-8d9f-4e42-9d57-1b7f4aeaa173 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:02.610070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d210e522-8d9f-4e42-9d57-1b7f4aeaa173 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:02.615037 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d210e522-8d9f-4e42-9d57-1b7f4aeaa173 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:02.615037 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d210e522-8d9f-4e42-9d57-1b7f4aeaa173 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:02.615037 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d210e522-8d9f-4e42-9d57-1b7f4aeaa173 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:02.615037 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d210e522-8d9f-4e42-9d57-1b7f4aeaa173 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:02.615659 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d210e522-8d9f-4e42-9d57-1b7f4aeaa173 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:02.722937 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f81b8f50-f444-4ca0-bebd-c5e94a3953e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:02.724148 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f81b8f50-f444-4ca0-bebd-c5e94a3953e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 1be8351b-602c-427c-915a-c0edd27cbfaf] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:02.732012 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f81b8f50-f444-4ca0-bebd-c5e94a3953e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:02.732705 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f81b8f50-f444-4ca0-bebd-c5e94a3953e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:02.733498 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f81b8f50-f444-4ca0-bebd-c5e94a3953e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:02.734545 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f81b8f50-f444-4ca0-bebd-c5e94a3953e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:02.735129 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f81b8f50-f444-4ca0-bebd-c5e94a3953e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:02.735691 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f81b8f50-f444-4ca0-bebd-c5e94a3953e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:02.761491 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-f81b8f50-f444-4ca0-bebd-c5e94a3953e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] HTTP exception thrown: Instance 1be8351b-602c-427c-915a-c0edd27cbfaf could not be found. Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f81b8f50-f444-4ca0-bebd-c5e94a3953e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Request method failure captured: Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf HTTP/1.1 Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTUBV54KXufTxPgBAlndN0DEguNRKzSRmEC5xewb2lPPOimeyFRSKSE-6O1bForpBT9-ggR6RsNJabRPmDZZQOEUgzIPpDU_UHM7JinN8BmN7CaDpBTpPmSAVaL8wDeAim5TRDVnE7RSL44Ykqa0DQF0eZupQ_CRNGNzjBu6MIoH0-w Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: f8ca070dc59e4a69bdaca0150f92bcc4 Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1630666147 Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 21:57:02.765659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 21:57:02.768851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:57:02.768851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1630666147 Aug 29 21:57:02.768851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: f8ca070dc59e4a69bdaca0150f92bcc4 Aug 29 21:57:02.768851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1630666147 Aug 29 21:57:02.768851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-ServerRescueNegativeTestJSON-1630666147-project Aug 29 21:57:02.768851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 21:57:02.768851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 21:57:02.768851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 3575098818954a949e202397a1b20a6a Aug 29 21:57:02.768851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1630666147-project Aug 29 21:57:02.768851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 21:57:02.768851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance 1be8351b-602c-427c-915a-c0edd27cbfaf could not be found. Aug 29 21:57:02.768851 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': '1be8351b-602c-427c-915a-c0edd27cbfaf'} Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1be8351b-602c-427c-915a-c0edd27cbfaf could not be found. Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:57:02.770345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1be8351b-602c-427c-915a-c0edd27cbfaf could not be found. Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1be8351b-602c-427c-915a-c0edd27cbfaf could not be found. Aug 29 21:57:02.773694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:02.778597 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f81b8f50-f444-4ca0-bebd-c5e94a3953e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Returning 404 to user: Instance 1be8351b-602c-427c-915a-c0edd27cbfaf could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:57:02.779749 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f81b8f50-f444-4ca0-bebd-c5e94a3953e9 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf" status: 404 len: 111 microversion: 2.1 time: 0.375611 Aug 29 21:57:02.781452 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 450/907] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:02 2022] GET /compute/v2.1/servers/1be8351b-602c-427c-915a-c0edd27cbfaf => generated 111 bytes in 378 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:57:02.791932 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-952b8e39-4488-446c-acfe-151a7c578aa1 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:02.793597 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-952b8e39-4488-446c-acfe-151a7c578aa1 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:02.807008 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-952b8e39-4488-446c-acfe-151a7c578aa1 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:02.808337 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-952b8e39-4488-446c-acfe-151a7c578aa1 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:02.809487 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-952b8e39-4488-446c-acfe-151a7c578aa1 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:02.811097 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-952b8e39-4488-446c-acfe-151a7c578aa1 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:02.812228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-952b8e39-4488-446c-acfe-151a7c578aa1 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:02.813300 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-952b8e39-4488-446c-acfe-151a7c578aa1 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:02.840445 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d210e522-8d9f-4e42-9d57-1b7f4aeaa173 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:02.851533 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d210e522-8d9f-4e42-9d57-1b7f4aeaa173 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:02.853187 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d210e522-8d9f-4e42-9d57-1b7f4aeaa173 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:02.854111 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:02.855237 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d210e522-8d9f-4e42-9d57-1b7f4aeaa173 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1740 microversion: 2.20 time: 0.257915 Aug 29 21:57:02.855982 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 458/908] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:02 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1740 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:57:02.861145 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9b123fe2-6348-44f8-b947-ca63a4958466 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:02.862030 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9b123fe2-6348-44f8-b947-ca63a4958466 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:02.868946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9b123fe2-6348-44f8-b947-ca63a4958466 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:02.869870 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9b123fe2-6348-44f8-b947-ca63a4958466 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:02.870564 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9b123fe2-6348-44f8-b947-ca63a4958466 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:02.871538 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9b123fe2-6348-44f8-b947-ca63a4958466 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:02.871760 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-952b8e39-4488-446c-acfe-151a7c578aa1 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments/25f05140-2579-46b7-9bfd-74dc23887928" status: 200 len: 194 microversion: 2.1 time: 0.088464 Aug 29 21:57:02.872438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9b123fe2-6348-44f8-b947-ca63a4958466 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:02.872729 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 451/909] 10.222.0.83 () {58 vars in 1413 bytes} [Mon Aug 29 21:57:02 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments/25f05140-2579-46b7-9bfd-74dc23887928 => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:57:02.873372 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9b123fe2-6348-44f8-b947-ca63a4958466 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:02.889679 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ad38ad4c-d93b-44f3-a1c0-f8c8c9b589bc tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:02.889679 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ad38ad4c-d93b-44f3-a1c0-f8c8c9b589bc tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:02.891907 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ad38ad4c-d93b-44f3-a1c0-f8c8c9b589bc tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:02.892417 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ad38ad4c-d93b-44f3-a1c0-f8c8c9b589bc tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:02.893122 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ad38ad4c-d93b-44f3-a1c0-f8c8c9b589bc tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:02.894016 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ad38ad4c-d93b-44f3-a1c0-f8c8c9b589bc tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:02.894656 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ad38ad4c-d93b-44f3-a1c0-f8c8c9b589bc tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:02.895294 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ad38ad4c-d93b-44f3-a1c0-f8c8c9b589bc tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:02.904694 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9b123fe2-6348-44f8-b947-ca63a4958466 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Going to try to terminate instance {{(pid=127882) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:57:03.000666 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-ad38ad4c-d93b-44f3-a1c0-f8c8c9b589bc tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lazy-loading 'services' on Instance uuid 8aeae90c-192c-4d96-833e-2e4cdf0538f9 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:57:03.314678 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9b123fe2-6348-44f8-b947-ca63a4958466 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "DELETE /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 204 len: 0 microversion: 2.1 time: 0.456936 Aug 29 21:57:03.315305 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 459/910] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:57:02 2022] DELETE /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:57:03.321757 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5518db1d-f2e9-4f98-830b-0dafee15ce92 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:03.322463 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5518db1d-f2e9-4f98-830b-0dafee15ce92 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:03.329165 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5518db1d-f2e9-4f98-830b-0dafee15ce92 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:03.329888 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5518db1d-f2e9-4f98-830b-0dafee15ce92 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:03.330367 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5518db1d-f2e9-4f98-830b-0dafee15ce92 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:03.331113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5518db1d-f2e9-4f98-830b-0dafee15ce92 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:03.331639 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5518db1d-f2e9-4f98-830b-0dafee15ce92 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:03.332106 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5518db1d-f2e9-4f98-830b-0dafee15ce92 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:03.355295 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ad38ad4c-d93b-44f3-a1c0-f8c8c9b589bc tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments/25f05140-2579-46b7-9bfd-74dc23887928" status: 202 len: 0 microversion: 2.1 time: 0.474964 Aug 29 21:57:03.359816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 452/911] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 21:57:02 2022] DELETE /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments/25f05140-2579-46b7-9bfd-74dc23887928 => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:57:03.367944 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-45d5bea3-8969-48af-b4bb-30a729d93da8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:03.369329 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-45d5bea3-8969-48af-b4bb-30a729d93da8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:03.381052 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-45d5bea3-8969-48af-b4bb-30a729d93da8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:03.381877 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-45d5bea3-8969-48af-b4bb-30a729d93da8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:03.382686 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-45d5bea3-8969-48af-b4bb-30a729d93da8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:03.383825 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-45d5bea3-8969-48af-b4bb-30a729d93da8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:03.384707 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-45d5bea3-8969-48af-b4bb-30a729d93da8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:03.385838 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-45d5bea3-8969-48af-b4bb-30a729d93da8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:03.506392 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5518db1d-f2e9-4f98-830b-0dafee15ce92 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:03.520062 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5518db1d-f2e9-4f98-830b-0dafee15ce92 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1578 microversion: 2.1 time: 0.203070 Aug 29 21:57:03.521414 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 460/912] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:03 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1578 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:03.548138 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-45d5bea3-8969-48af-b4bb-30a729d93da8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:03.557519 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-45d5bea3-8969-48af-b4bb-30a729d93da8 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.198917 Aug 29 21:57:03.558118 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 453/913] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:03 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:03.881408 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-3dbb11be-7965-4ef7-b871-7f4da64021f6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:03.882105 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3dbb11be-7965-4ef7-b871-7f4da64021f6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:03.889237 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3dbb11be-7965-4ef7-b871-7f4da64021f6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:03.889740 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3dbb11be-7965-4ef7-b871-7f4da64021f6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:03.890179 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3dbb11be-7965-4ef7-b871-7f4da64021f6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:03.890933 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3dbb11be-7965-4ef7-b871-7f4da64021f6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:03.891390 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3dbb11be-7965-4ef7-b871-7f4da64021f6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:03.891821 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3dbb11be-7965-4ef7-b871-7f4da64021f6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:04.067820 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-3dbb11be-7965-4ef7-b871-7f4da64021f6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:04.076430 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-3dbb11be-7965-4ef7-b871-7f4da64021f6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:04.077935 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-3dbb11be-7965-4ef7-b871-7f4da64021f6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:04.079109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-3dbb11be-7965-4ef7-b871-7f4da64021f6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1740 microversion: 2.20 time: 0.201912 Aug 29 21:57:04.079684 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 461/914] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:03 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:04.391121 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-fc2a2b0c-8b56-4144-a693-358ffdedc84b req-51fc05bd-986f-4171-937c-12a535a613ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90c4eb2-99e9-4c0f-9336-0ecd87390a9f", "name": "network-vif-plugged", "status": "completed", "tag": "245c7474-204e-46f8-a4ef-735e7fa0f46e"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:04.404310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-fc2a2b0c-8b56-4144-a693-358ffdedc84b req-51fc05bd-986f-4171-937c-12a535a613ae service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:04.404893 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-fc2a2b0c-8b56-4144-a693-358ffdedc84b req-51fc05bd-986f-4171-937c-12a535a613ae service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:04.405393 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-fc2a2b0c-8b56-4144-a693-358ffdedc84b req-51fc05bd-986f-4171-937c-12a535a613ae service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:04.420907 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-fc2a2b0c-8b56-4144-a693-358ffdedc84b req-51fc05bd-986f-4171-937c-12a535a613ae service nova] Creating event network-vif-plugged:245c7474-204e-46f8-a4ef-735e7fa0f46e for instance b90c4eb2-99e9-4c0f-9336-0ecd87390a9f on hv-cinder-85426 Aug 29 21:57:04.426688 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-fc2a2b0c-8b56-4144-a693-358ffdedc84b req-51fc05bd-986f-4171-937c-12a535a613ae service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041316 Aug 29 21:57:04.427338 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 454/915] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:57:04.547900 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-776ffcda-6462-435b-a93c-0406b753639b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:04.549070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-776ffcda-6462-435b-a93c-0406b753639b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:04.555577 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-776ffcda-6462-435b-a93c-0406b753639b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:04.556067 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-776ffcda-6462-435b-a93c-0406b753639b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:04.556529 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-776ffcda-6462-435b-a93c-0406b753639b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:04.557272 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-776ffcda-6462-435b-a93c-0406b753639b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:04.557684 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-776ffcda-6462-435b-a93c-0406b753639b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:04.558101 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-776ffcda-6462-435b-a93c-0406b753639b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:04.580622 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d725b8ef-cb54-4ac9-8395-f3a4ca8df8c0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:04.581327 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d725b8ef-cb54-4ac9-8395-f3a4ca8df8c0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:04.595675 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d725b8ef-cb54-4ac9-8395-f3a4ca8df8c0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:04.596985 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d725b8ef-cb54-4ac9-8395-f3a4ca8df8c0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:04.597790 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d725b8ef-cb54-4ac9-8395-f3a4ca8df8c0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:04.599724 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d725b8ef-cb54-4ac9-8395-f3a4ca8df8c0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:04.601138 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d725b8ef-cb54-4ac9-8395-f3a4ca8df8c0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:04.601790 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d725b8ef-cb54-4ac9-8395-f3a4ca8df8c0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:04.754184 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-776ffcda-6462-435b-a93c-0406b753639b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:04.759674 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-776ffcda-6462-435b-a93c-0406b753639b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1578 microversion: 2.1 time: 0.215612 Aug 29 21:57:04.760271 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 462/916] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:04 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1578 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:57:04.784038 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d725b8ef-cb54-4ac9-8395-f3a4ca8df8c0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:04.794504 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d725b8ef-cb54-4ac9-8395-f3a4ca8df8c0 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.217958 Aug 29 21:57:04.796028 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 455/917] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:04 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:57:05.103750 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-722fac9e-5f40-42c0-b751-76986dd0dfa4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:05.104634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-722fac9e-5f40-42c0-b751-76986dd0dfa4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:05.112700 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-722fac9e-5f40-42c0-b751-76986dd0dfa4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:05.113348 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-722fac9e-5f40-42c0-b751-76986dd0dfa4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:05.113904 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-722fac9e-5f40-42c0-b751-76986dd0dfa4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:05.114736 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-722fac9e-5f40-42c0-b751-76986dd0dfa4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:05.115381 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-722fac9e-5f40-42c0-b751-76986dd0dfa4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:05.116190 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-722fac9e-5f40-42c0-b751-76986dd0dfa4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:05.264293 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-722fac9e-5f40-42c0-b751-76986dd0dfa4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:05.280420 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-722fac9e-5f40-42c0-b751-76986dd0dfa4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:05.283210 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-722fac9e-5f40-42c0-b751-76986dd0dfa4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:05.285435 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-722fac9e-5f40-42c0-b751-76986dd0dfa4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1740 microversion: 2.20 time: 0.186282 Aug 29 21:57:05.286425 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 463/918] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:05 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:57:05.781148 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-64f63087-e675-4ceb-8f7e-5e9cf643de94 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:05.781915 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-64f63087-e675-4ceb-8f7e-5e9cf643de94 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:05.788610 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-64f63087-e675-4ceb-8f7e-5e9cf643de94 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:05.789115 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-64f63087-e675-4ceb-8f7e-5e9cf643de94 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:05.789560 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-64f63087-e675-4ceb-8f7e-5e9cf643de94 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:05.790275 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-64f63087-e675-4ceb-8f7e-5e9cf643de94 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:05.790737 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-64f63087-e675-4ceb-8f7e-5e9cf643de94 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:05.791167 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-64f63087-e675-4ceb-8f7e-5e9cf643de94 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:05.821010 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-7022067d-9d94-482e-93a2-509953e96ff2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:05.822060 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-7022067d-9d94-482e-93a2-509953e96ff2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:05.831501 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7022067d-9d94-482e-93a2-509953e96ff2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:05.832590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7022067d-9d94-482e-93a2-509953e96ff2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:05.833263 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7022067d-9d94-482e-93a2-509953e96ff2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:05.838572 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7022067d-9d94-482e-93a2-509953e96ff2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:05.838572 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7022067d-9d94-482e-93a2-509953e96ff2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:05.838572 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7022067d-9d94-482e-93a2-509953e96ff2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:05.956373 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-64f63087-e675-4ceb-8f7e-5e9cf643de94 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:05.965116 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-64f63087-e675-4ceb-8f7e-5e9cf643de94 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1578 microversion: 2.1 time: 0.187910 Aug 29 21:57:05.965697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 456/919] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:05 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1578 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:57:06.002640 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-7022067d-9d94-482e-93a2-509953e96ff2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:06.017468 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-7022067d-9d94-482e-93a2-509953e96ff2 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.201342 Aug 29 21:57:06.018560 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 464/920] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:05 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:57:06.309732 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a89f7d48-9a1a-4256-a79f-7ff9b5df8686 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:06.310336 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a89f7d48-9a1a-4256-a79f-7ff9b5df8686 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:06.316269 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a89f7d48-9a1a-4256-a79f-7ff9b5df8686 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:06.316777 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a89f7d48-9a1a-4256-a79f-7ff9b5df8686 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:06.317219 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a89f7d48-9a1a-4256-a79f-7ff9b5df8686 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:06.317962 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a89f7d48-9a1a-4256-a79f-7ff9b5df8686 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:06.318412 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a89f7d48-9a1a-4256-a79f-7ff9b5df8686 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:06.318833 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a89f7d48-9a1a-4256-a79f-7ff9b5df8686 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:06.442674 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-703ba715-8877-4be0-a186-be8b1f84494f req-2ceadfc7-c1ce-4cf2-ba07-764f8d18ddde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01db998-129a-4b44-a3c4-1da1bf023620", "name": "network-vif-unplugged", "status": "completed", "tag": "95ba8615-923a-46f1-ae70-f15459156d2b"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:06.452273 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-703ba715-8877-4be0-a186-be8b1f84494f req-2ceadfc7-c1ce-4cf2-ba07-764f8d18ddde service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:06.452790 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-703ba715-8877-4be0-a186-be8b1f84494f req-2ceadfc7-c1ce-4cf2-ba07-764f8d18ddde service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:06.453223 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-703ba715-8877-4be0-a186-be8b1f84494f req-2ceadfc7-c1ce-4cf2-ba07-764f8d18ddde service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:06.458203 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a89f7d48-9a1a-4256-a79f-7ff9b5df8686 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:06.466733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-703ba715-8877-4be0-a186-be8b1f84494f req-2ceadfc7-c1ce-4cf2-ba07-764f8d18ddde service nova] Creating event network-vif-unplugged:95ba8615-923a-46f1-ae70-f15459156d2b for instance d01db998-129a-4b44-a3c4-1da1bf023620 on hv-cinder-85426 Aug 29 21:57:06.470872 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a89f7d48-9a1a-4256-a79f-7ff9b5df8686 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:06.472073 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a89f7d48-9a1a-4256-a79f-7ff9b5df8686 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:06.472276 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-703ba715-8877-4be0-a186-be8b1f84494f req-2ceadfc7-c1ce-4cf2-ba07-764f8d18ddde service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034605 Aug 29 21:57:06.472782 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 465/921] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:57:06.473262 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a89f7d48-9a1a-4256-a79f-7ff9b5df8686 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1740 microversion: 2.20 time: 0.167501 Aug 29 21:57:06.473827 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 457/922] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:06 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:07.000728 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d732964c-48ca-4bd1-a1c5-c61063cb454d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:07.001438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d732964c-48ca-4bd1-a1c5-c61063cb454d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:07.003503 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:07.010026 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d732964c-48ca-4bd1-a1c5-c61063cb454d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:07.010571 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d732964c-48ca-4bd1-a1c5-c61063cb454d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:07.011097 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d732964c-48ca-4bd1-a1c5-c61063cb454d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:07.011800 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d732964c-48ca-4bd1-a1c5-c61063cb454d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:07.012315 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d732964c-48ca-4bd1-a1c5-c61063cb454d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:07.012794 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d732964c-48ca-4bd1-a1c5-c61063cb454d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:07.040792 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-49891cef-9ef3-4f26-bc4e-cb5ef4d19009 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:07.043128 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-49891cef-9ef3-4f26-bc4e-cb5ef4d19009 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:07.048658 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-49891cef-9ef3-4f26-bc4e-cb5ef4d19009 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:07.049495 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-49891cef-9ef3-4f26-bc4e-cb5ef4d19009 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:07.049880 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-49891cef-9ef3-4f26-bc4e-cb5ef4d19009 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:07.050592 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-49891cef-9ef3-4f26-bc4e-cb5ef4d19009 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:07.051055 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-49891cef-9ef3-4f26-bc4e-cb5ef4d19009 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:07.051490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-49891cef-9ef3-4f26-bc4e-cb5ef4d19009 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:07.157025 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d732964c-48ca-4bd1-a1c5-c61063cb454d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:07.165613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d732964c-48ca-4bd1-a1c5-c61063cb454d tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1578 microversion: 2.1 time: 0.169460 Aug 29 21:57:07.166191 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 466/923] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:06 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:07.197440 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-49891cef-9ef3-4f26-bc4e-cb5ef4d19009 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:07.207020 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-49891cef-9ef3-4f26-bc4e-cb5ef4d19009 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1521 microversion: 2.1 time: 0.171186 Aug 29 21:57:07.216979 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 458/924] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:07 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:57:07.497366 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6fa552ca-abe9-47d4-9545-46844a7fb85a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:07.497968 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-6fa552ca-abe9-47d4-9545-46844a7fb85a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:07.505116 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6fa552ca-abe9-47d4-9545-46844a7fb85a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:07.505601 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6fa552ca-abe9-47d4-9545-46844a7fb85a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:07.506527 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6fa552ca-abe9-47d4-9545-46844a7fb85a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:07.507235 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6fa552ca-abe9-47d4-9545-46844a7fb85a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:07.507684 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6fa552ca-abe9-47d4-9545-46844a7fb85a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:07.508112 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6fa552ca-abe9-47d4-9545-46844a7fb85a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:07.695906 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-6fa552ca-abe9-47d4-9545-46844a7fb85a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:07.706786 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-6fa552ca-abe9-47d4-9545-46844a7fb85a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:07.709091 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-6fa552ca-abe9-47d4-9545-46844a7fb85a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:07.710969 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-6fa552ca-abe9-47d4-9545-46844a7fb85a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1722 microversion: 2.20 time: 0.217413 Aug 29 21:57:07.711588 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 467/925] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:07 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:57:08.187861 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7bd62079-a235-44f1-abb8-6e5d4759238b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:08.189022 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7bd62079-a235-44f1-abb8-6e5d4759238b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:08.197307 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7bd62079-a235-44f1-abb8-6e5d4759238b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:08.197892 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7bd62079-a235-44f1-abb8-6e5d4759238b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:08.198123 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7bd62079-a235-44f1-abb8-6e5d4759238b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:08.198853 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7bd62079-a235-44f1-abb8-6e5d4759238b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:08.199305 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7bd62079-a235-44f1-abb8-6e5d4759238b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:08.199736 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7bd62079-a235-44f1-abb8-6e5d4759238b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:08.210027 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-b633fd68-93dc-4516-b1ed-c1a1a4e01627 req-19eddd96-4f64-4216-9cfe-928d7611e7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a4fc48-d58f-4227-a8aa-5d4d227c33d8", "name": "network-vif-deleted", "tag": "15cd5989-a04d-4d6e-9c81-fdd78d421299"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:08.222037 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-b633fd68-93dc-4516-b1ed-c1a1a4e01627 req-19eddd96-4f64-4216-9cfe-928d7611e7f0 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:08.222602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-b633fd68-93dc-4516-b1ed-c1a1a4e01627 req-19eddd96-4f64-4216-9cfe-928d7611e7f0 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:08.223259 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-b633fd68-93dc-4516-b1ed-c1a1a4e01627 req-19eddd96-4f64-4216-9cfe-928d7611e7f0 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:08.245498 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-b633fd68-93dc-4516-b1ed-c1a1a4e01627 req-19eddd96-4f64-4216-9cfe-928d7611e7f0 service nova] Creating event network-vif-deleted:15cd5989-a04d-4d6e-9c81-fdd78d421299 for instance 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 on hv-cinder-85426 Aug 29 21:57:08.254595 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-b633fd68-93dc-4516-b1ed-c1a1a4e01627 req-19eddd96-4f64-4216-9cfe-928d7611e7f0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049824 Aug 29 21:57:08.256692 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 468/926] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:57:08.267253 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b77ccf1e-eae3-4631-affb-83e2abce2e5b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:08.268376 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b77ccf1e-eae3-4631-affb-83e2abce2e5b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:08.280992 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b77ccf1e-eae3-4631-affb-83e2abce2e5b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:08.283168 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b77ccf1e-eae3-4631-affb-83e2abce2e5b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:08.284509 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b77ccf1e-eae3-4631-affb-83e2abce2e5b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:08.285385 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b77ccf1e-eae3-4631-affb-83e2abce2e5b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:08.286213 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b77ccf1e-eae3-4631-affb-83e2abce2e5b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:08.286844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b77ccf1e-eae3-4631-affb-83e2abce2e5b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:08.327373 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:08.395592 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-b77ccf1e-eae3-4631-affb-83e2abce2e5b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:08.408115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b77ccf1e-eae3-4631-affb-83e2abce2e5b tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1479 microversion: 2.1 time: 0.149316 Aug 29 21:57:08.409344 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 469/927] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:08 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1479 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:08.411685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7bd62079-a235-44f1-abb8-6e5d4759238b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:08.426764 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7bd62079-a235-44f1-abb8-6e5d4759238b tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1578 microversion: 2.1 time: 0.242107 Aug 29 21:57:08.428241 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 459/928] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:08 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1578 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:57:08.742986 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-077b64e4-b83b-4f79-b2e4-84bb794e8b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:08.744266 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-077b64e4-b83b-4f79-b2e4-84bb794e8b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:08.756279 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-077b64e4-b83b-4f79-b2e4-84bb794e8b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:08.757265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-077b64e4-b83b-4f79-b2e4-84bb794e8b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:08.758316 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-077b64e4-b83b-4f79-b2e4-84bb794e8b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:08.767179 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-077b64e4-b83b-4f79-b2e4-84bb794e8b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:08.768638 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-077b64e4-b83b-4f79-b2e4-84bb794e8b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:08.769320 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-077b64e4-b83b-4f79-b2e4-84bb794e8b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:08.790489 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-399ca942-1a55-464d-8145-7abd183dfd4c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:08.791279 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-399ca942-1a55-464d-8145-7abd183dfd4c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:08.799960 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:08.802205 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-399ca942-1a55-464d-8145-7abd183dfd4c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:08.804627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-399ca942-1a55-464d-8145-7abd183dfd4c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:08.804627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-399ca942-1a55-464d-8145-7abd183dfd4c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:08.804627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-399ca942-1a55-464d-8145-7abd183dfd4c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:08.804627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-399ca942-1a55-464d-8145-7abd183dfd4c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:08.805408 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-399ca942-1a55-464d-8145-7abd183dfd4c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:08.845277 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-399ca942-1a55-464d-8145-7abd183dfd4c tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments/fd4580cb-c9e0-477e-b07d-635c80cec8b7" status: 200 len: 194 microversion: 2.1 time: 0.063043 Aug 29 21:57:08.845909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 460/929] 10.222.0.83 () {58 vars in 1413 bytes} [Mon Aug 29 21:57:08 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments/fd4580cb-c9e0-477e-b07d-635c80cec8b7 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:57:08.858597 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a5543f3f-efa5-4415-8675-773ebc69d281 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:08.859373 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a5543f3f-efa5-4415-8675-773ebc69d281 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:08.866572 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a5543f3f-efa5-4415-8675-773ebc69d281 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:08.867427 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a5543f3f-efa5-4415-8675-773ebc69d281 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:08.868611 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a5543f3f-efa5-4415-8675-773ebc69d281 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:08.868611 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a5543f3f-efa5-4415-8675-773ebc69d281 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:08.869314 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a5543f3f-efa5-4415-8675-773ebc69d281 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:08.869751 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a5543f3f-efa5-4415-8675-773ebc69d281 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:08.968109 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-a5543f3f-efa5-4415-8675-773ebc69d281 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lazy-loading 'services' on Instance uuid 8aeae90c-192c-4d96-833e-2e4cdf0538f9 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:57:08.972736 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-077b64e4-b83b-4f79-b2e4-84bb794e8b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:08.982035 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-077b64e4-b83b-4f79-b2e4-84bb794e8b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:08.983472 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-077b64e4-b83b-4f79-b2e4-84bb794e8b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:08.984696 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-077b64e4-b83b-4f79-b2e4-84bb794e8b77 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1722 microversion: 2.20 time: 0.248953 Aug 29 21:57:08.985272 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 470/930] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:08 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:09.279963 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a5543f3f-efa5-4415-8675-773ebc69d281 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments/fd4580cb-c9e0-477e-b07d-635c80cec8b7" status: 202 len: 0 microversion: 2.1 time: 0.426259 Aug 29 21:57:09.280662 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 461/931] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 21:57:08 2022] DELETE /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments/fd4580cb-c9e0-477e-b07d-635c80cec8b7 => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:57:09.431272 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9d41db33-109a-43eb-be65-063578d49c60 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:09.432200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9d41db33-109a-43eb-be65-063578d49c60 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:09.438823 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9d41db33-109a-43eb-be65-063578d49c60 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:09.439313 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9d41db33-109a-43eb-be65-063578d49c60 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:09.439911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9d41db33-109a-43eb-be65-063578d49c60 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:09.442342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9d41db33-109a-43eb-be65-063578d49c60 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:09.442342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9d41db33-109a-43eb-be65-063578d49c60 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:09.442342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9d41db33-109a-43eb-be65-063578d49c60 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:09.450255 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-10244c8a-898e-4880-b9b7-a1e1f326e9f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:09.450954 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-10244c8a-898e-4880-b9b7-a1e1f326e9f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:09.457756 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10244c8a-898e-4880-b9b7-a1e1f326e9f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:09.458272 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10244c8a-898e-4880-b9b7-a1e1f326e9f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:09.458682 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10244c8a-898e-4880-b9b7-a1e1f326e9f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:09.460140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10244c8a-898e-4880-b9b7-a1e1f326e9f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:09.460623 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10244c8a-898e-4880-b9b7-a1e1f326e9f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:09.461054 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10244c8a-898e-4880-b9b7-a1e1f326e9f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:09.476926 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9d41db33-109a-43eb-be65-063578d49c60 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:09.477411 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9d41db33-109a-43eb-be65-063578d49c60 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:09.477849 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9d41db33-109a-43eb-be65-063578d49c60 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:09.478297 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-9d41db33-109a-43eb-be65-063578d49c60 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lazy-loading 'fault' on Instance uuid 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:57:09.553506 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9d41db33-109a-43eb-be65-063578d49c60 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:09.567739 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9d41db33-109a-43eb-be65-063578d49c60 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1312 microversion: 2.1 time: 0.140893 Aug 29 21:57:09.581139 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 471/932] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:09 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1312 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:09.797836 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-10244c8a-898e-4880-b9b7-a1e1f326e9f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:09.808274 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-10244c8a-898e-4880-b9b7-a1e1f326e9f5 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1578 microversion: 2.1 time: 0.361924 Aug 29 21:57:09.819032 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 462/933] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:09 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1578 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:57:10.020559 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-17049b62-b47f-4201-8e0d-57d8fe713519 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:10.021435 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-17049b62-b47f-4201-8e0d-57d8fe713519 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:10.029604 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-17049b62-b47f-4201-8e0d-57d8fe713519 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:10.029979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-17049b62-b47f-4201-8e0d-57d8fe713519 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:10.030417 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-17049b62-b47f-4201-8e0d-57d8fe713519 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:10.031136 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-17049b62-b47f-4201-8e0d-57d8fe713519 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:10.031780 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-17049b62-b47f-4201-8e0d-57d8fe713519 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:10.032320 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-17049b62-b47f-4201-8e0d-57d8fe713519 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:10.208354 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-17049b62-b47f-4201-8e0d-57d8fe713519 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:10.218690 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-17049b62-b47f-4201-8e0d-57d8fe713519 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:10.220117 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-17049b62-b47f-4201-8e0d-57d8fe713519 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:10.221318 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-17049b62-b47f-4201-8e0d-57d8fe713519 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1722 microversion: 2.20 time: 0.206134 Aug 29 21:57:10.223264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 472/934] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:10 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:10.590579 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d02fbf42-c911-480e-80f1-ca6717a34871 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:10.591177 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d02fbf42-c911-480e-80f1-ca6717a34871 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:10.597910 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d02fbf42-c911-480e-80f1-ca6717a34871 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:10.598448 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d02fbf42-c911-480e-80f1-ca6717a34871 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:10.598838 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d02fbf42-c911-480e-80f1-ca6717a34871 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:10.600031 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d02fbf42-c911-480e-80f1-ca6717a34871 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:10.600507 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d02fbf42-c911-480e-80f1-ca6717a34871 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:10.601576 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d02fbf42-c911-480e-80f1-ca6717a34871 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:10.639041 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d02fbf42-c911-480e-80f1-ca6717a34871 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:10.639532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d02fbf42-c911-480e-80f1-ca6717a34871 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:10.639983 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d02fbf42-c911-480e-80f1-ca6717a34871 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:10.640437 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-d02fbf42-c911-480e-80f1-ca6717a34871 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lazy-loading 'fault' on Instance uuid 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:57:10.688101 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d02fbf42-c911-480e-80f1-ca6717a34871 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:10.695941 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d02fbf42-c911-480e-80f1-ca6717a34871 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1312 microversion: 2.1 time: 0.110071 Aug 29 21:57:10.696551 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 463/935] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:10 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:10.830228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d3eb51c6-bb03-4ca8-acb5-83550e98c42c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:10.830845 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d3eb51c6-bb03-4ca8-acb5-83550e98c42c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:10.837395 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d3eb51c6-bb03-4ca8-acb5-83550e98c42c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:10.837893 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d3eb51c6-bb03-4ca8-acb5-83550e98c42c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:10.838347 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d3eb51c6-bb03-4ca8-acb5-83550e98c42c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:10.839079 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d3eb51c6-bb03-4ca8-acb5-83550e98c42c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:10.839526 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d3eb51c6-bb03-4ca8-acb5-83550e98c42c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:10.839952 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d3eb51c6-bb03-4ca8-acb5-83550e98c42c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:10.984180 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d3eb51c6-bb03-4ca8-acb5-83550e98c42c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:10.993044 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d3eb51c6-bb03-4ca8-acb5-83550e98c42c tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1565 microversion: 2.1 time: 0.166535 Aug 29 21:57:10.993645 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 473/936] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:10 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:11.243685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-cba1823f-719d-4d87-a133-cb287741da86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:11.244217 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-cba1823f-719d-4d87-a133-cb287741da86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:11.250319 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cba1823f-719d-4d87-a133-cb287741da86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:11.250814 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cba1823f-719d-4d87-a133-cb287741da86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:11.251261 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cba1823f-719d-4d87-a133-cb287741da86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:11.251984 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cba1823f-719d-4d87-a133-cb287741da86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:11.252521 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cba1823f-719d-4d87-a133-cb287741da86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:11.252952 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-cba1823f-719d-4d87-a133-cb287741da86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:11.405220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-cba1823f-719d-4d87-a133-cb287741da86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:11.417285 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-cba1823f-719d-4d87-a133-cb287741da86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:11.419071 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-cba1823f-719d-4d87-a133-cb287741da86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:11.421094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-cba1823f-719d-4d87-a133-cb287741da86 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1722 microversion: 2.20 time: 0.180840 Aug 29 21:57:11.422064 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 464/937] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:11 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:11.716721 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-99fa0bd0-fb0c-466f-a13d-4af054736370 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:11.717391 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-99fa0bd0-fb0c-466f-a13d-4af054736370 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:11.725945 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-99fa0bd0-fb0c-466f-a13d-4af054736370 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:11.726682 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-99fa0bd0-fb0c-466f-a13d-4af054736370 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:11.727290 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-99fa0bd0-fb0c-466f-a13d-4af054736370 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:11.728338 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-99fa0bd0-fb0c-466f-a13d-4af054736370 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:11.729151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-99fa0bd0-fb0c-466f-a13d-4af054736370 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:11.729823 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-99fa0bd0-fb0c-466f-a13d-4af054736370 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:11.924390 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-99fa0bd0-fb0c-466f-a13d-4af054736370 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:11.925103 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-99fa0bd0-fb0c-466f-a13d-4af054736370 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:11.925508 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-99fa0bd0-fb0c-466f-a13d-4af054736370 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:11.926168 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-99fa0bd0-fb0c-466f-a13d-4af054736370 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lazy-loading 'fault' on Instance uuid 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:57:11.971845 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-99fa0bd0-fb0c-466f-a13d-4af054736370 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3575098818954a949e202397a1b20a6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:11.980007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-99fa0bd0-fb0c-466f-a13d-4af054736370 tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 200 len: 1312 microversion: 2.1 time: 0.267187 Aug 29 21:57:11.980626 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 474/938] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:11 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 1312 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:12.445556 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-d1a1007d-d309-4851-83b4-92d2d662d62b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:12.446827 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-d1a1007d-d309-4851-83b4-92d2d662d62b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:12.455380 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d1a1007d-d309-4851-83b4-92d2d662d62b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:12.455873 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d1a1007d-d309-4851-83b4-92d2d662d62b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:12.456314 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d1a1007d-d309-4851-83b4-92d2d662d62b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:12.457055 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d1a1007d-d309-4851-83b4-92d2d662d62b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:12.457517 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d1a1007d-d309-4851-83b4-92d2d662d62b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:12.457947 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-d1a1007d-d309-4851-83b4-92d2d662d62b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:12.592778 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0bae0921-b738-4734-8e96-6313f714088a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:12.595033 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-0bae0921-b738-4734-8e96-6313f714088a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:12.611508 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0bae0921-b738-4734-8e96-6313f714088a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:12.611508 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0bae0921-b738-4734-8e96-6313f714088a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:12.611508 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0bae0921-b738-4734-8e96-6313f714088a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:12.611508 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0bae0921-b738-4734-8e96-6313f714088a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:12.611911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0bae0921-b738-4734-8e96-6313f714088a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:12.611911 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0bae0921-b738-4734-8e96-6313f714088a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:12.635576 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d1a1007d-d309-4851-83b4-92d2d662d62b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:12.638214 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-0bae0921-b738-4734-8e96-6313f714088a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049644 Aug 29 21:57:12.643261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 475/939] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 21:57:12 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 21:57:12.644671 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d1a1007d-d309-4851-83b4-92d2d662d62b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:12.647107 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-d1a1007d-d309-4851-83b4-92d2d662d62b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:12.648573 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-d1a1007d-d309-4851-83b4-92d2d662d62b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1722 microversion: 2.20 time: 0.207066 Aug 29 21:57:12.649148 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 465/940] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:12 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:12.781999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-342ec171-b03b-4e95-8432-ee8b70ced724 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:12.785549 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-342ec171-b03b-4e95-8432-ee8b70ced724 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:12.792086 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-342ec171-b03b-4e95-8432-ee8b70ced724 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:12.792590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-342ec171-b03b-4e95-8432-ee8b70ced724 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:12.793034 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-342ec171-b03b-4e95-8432-ee8b70ced724 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:12.793772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-342ec171-b03b-4e95-8432-ee8b70ced724 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:12.794297 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-342ec171-b03b-4e95-8432-ee8b70ced724 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:12.794755 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-342ec171-b03b-4e95-8432-ee8b70ced724 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:12.826518 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-342ec171-b03b-4e95-8432-ee8b70ced724 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048959 Aug 29 21:57:12.827096 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 476/941] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 21:57:12 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:57:12.893234 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b0bc81aa-a6d3-489b-9805-09c8e9c54cc4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:12.893742 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b0bc81aa-a6d3-489b-9805-09c8e9c54cc4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:12.900598 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b0bc81aa-a6d3-489b-9805-09c8e9c54cc4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:12.901110 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b0bc81aa-a6d3-489b-9805-09c8e9c54cc4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:12.901555 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b0bc81aa-a6d3-489b-9805-09c8e9c54cc4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:12.902274 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b0bc81aa-a6d3-489b-9805-09c8e9c54cc4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:12.902734 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b0bc81aa-a6d3-489b-9805-09c8e9c54cc4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:12.903164 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b0bc81aa-a6d3-489b-9805-09c8e9c54cc4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:12.933496 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b0bc81aa-a6d3-489b-9805-09c8e9c54cc4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Going to try to terminate instance {{(pid=127883) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:57:12.957959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:13.004258 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b52eaa02-428b-4f50-8bd5-92a9bef965cc tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:13.004808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-b52eaa02-428b-4f50-8bd5-92a9bef965cc tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] [instance: 64a4fc48-d58f-4227-a8aa-5d4d227c33d8] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:13.011584 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b52eaa02-428b-4f50-8bd5-92a9bef965cc tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:13.012073 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b52eaa02-428b-4f50-8bd5-92a9bef965cc tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:13.012537 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b52eaa02-428b-4f50-8bd5-92a9bef965cc tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:13.013246 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b52eaa02-428b-4f50-8bd5-92a9bef965cc tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:13.013734 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b52eaa02-428b-4f50-8bd5-92a9bef965cc tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:13.014164 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-b52eaa02-428b-4f50-8bd5-92a9bef965cc tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:13.029236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-b52eaa02-428b-4f50-8bd5-92a9bef965cc tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] HTTP exception thrown: Instance 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 could not be found. Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b52eaa02-428b-4f50-8bd5-92a9bef965cc tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Request method failure captured: Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 HTTP/1.1 Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTUBV54KXufTxPgBAlndN0DEguNRKzSRmEC5xewb2lPPOimeyFRSKSE-6O1bForpBT9-ggR6RsNJabRPmDZZQOEUgzIPpDU_UHM7JinN8BmN7CaDpBTpPmSAVaL8wDeAim5TRDVnE7RSL44Ykqa0DQF0eZupQ_CRNGNzjBu6MIoH0-w Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: f8ca070dc59e4a69bdaca0150f92bcc4 Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1630666147 Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:57:13.030909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:57:13.032423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/f8ca070dc59e4a69bdaca0150f92bcc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:57:13.032423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1630666147 Aug 29 21:57:13.032423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: f8ca070dc59e4a69bdaca0150f92bcc4 Aug 29 21:57:13.032423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1630666147 Aug 29 21:57:13.032423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-ServerRescueNegativeTestJSON-1630666147-project Aug 29 21:57:13.032423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:57:13.032423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:57:13.032423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 3575098818954a949e202397a1b20a6a Aug 29 21:57:13.032423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1630666147-project Aug 29 21:57:13.032423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:57:13.032423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 could not be found. Aug 29 21:57:13.032423 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '64a4fc48-d58f-4227-a8aa-5d4d227c33d8'} Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 could not be found. Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:57:13.040135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 could not be found. Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 could not be found. Aug 29 21:57:13.042093 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:13.043450 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-b52eaa02-428b-4f50-8bd5-92a9bef965cc tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] Returning 404 to user: Instance 64a4fc48-d58f-4227-a8aa-5d4d227c33d8 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:57:13.043450 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-b52eaa02-428b-4f50-8bd5-92a9bef965cc tempest-ServerRescueNegativeTestJSON-1630666147 tempest-ServerRescueNegativeTestJSON-1630666147-project] 10.222.0.83 "GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8" status: 404 len: 111 microversion: 2.1 time: 0.032114 Aug 29 21:57:13.043450 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 477/942] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:12 2022] GET /compute/v2.1/servers/64a4fc48-d58f-4227-a8aa-5d4d227c33d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:57:13.292419 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b0bc81aa-a6d3-489b-9805-09c8e9c54cc4 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 204 len: 0 microversion: 2.1 time: 0.403306 Aug 29 21:57:13.293081 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 466/943] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:57:12 2022] DELETE /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:57:13.303382 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-72b59a7e-bc47-4133-8e4c-4f302e870206 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:13.303991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-72b59a7e-bc47-4133-8e4c-4f302e870206 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:13.310696 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-72b59a7e-bc47-4133-8e4c-4f302e870206 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:13.311182 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-72b59a7e-bc47-4133-8e4c-4f302e870206 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:13.311658 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-72b59a7e-bc47-4133-8e4c-4f302e870206 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:13.312554 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-72b59a7e-bc47-4133-8e4c-4f302e870206 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:13.313174 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-72b59a7e-bc47-4133-8e4c-4f302e870206 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:13.313609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-72b59a7e-bc47-4133-8e4c-4f302e870206 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:13.547974 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-72b59a7e-bc47-4133-8e4c-4f302e870206 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:13.557250 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-72b59a7e-bc47-4133-8e4c-4f302e870206 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1673 microversion: 2.1 time: 0.258353 Aug 29 21:57:13.557832 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 478/944] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:13 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1673 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:13.672725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ec08908b-4c0e-4b4a-a4bb-50c6f3f24ff4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:13.673628 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ec08908b-4c0e-4b4a-a4bb-50c6f3f24ff4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:13.681175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ec08908b-4c0e-4b4a-a4bb-50c6f3f24ff4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:13.681683 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ec08908b-4c0e-4b4a-a4bb-50c6f3f24ff4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:13.682119 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ec08908b-4c0e-4b4a-a4bb-50c6f3f24ff4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:13.682833 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ec08908b-4c0e-4b4a-a4bb-50c6f3f24ff4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:13.683329 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ec08908b-4c0e-4b4a-a4bb-50c6f3f24ff4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:13.683763 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ec08908b-4c0e-4b4a-a4bb-50c6f3f24ff4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:13.864001 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ec08908b-4c0e-4b4a-a4bb-50c6f3f24ff4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:13.873692 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ec08908b-4c0e-4b4a-a4bb-50c6f3f24ff4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:13.875275 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ec08908b-4c0e-4b4a-a4bb-50c6f3f24ff4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:13.876563 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ec08908b-4c0e-4b4a-a4bb-50c6f3f24ff4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1665 microversion: 2.20 time: 0.208886 Aug 29 21:57:13.877212 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 467/945] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:13 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1665 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:13.913692 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a59e2bdc-3954-488f-b4ad-ad4389a09021 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d3ff49f-268a-4668-ac05-c125579baac5"}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:13.916128 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a59e2bdc-3954-488f-b4ad-ad4389a09021 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:13.923203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a59e2bdc-3954-488f-b4ad-ad4389a09021 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:13.923736 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a59e2bdc-3954-488f-b4ad-ad4389a09021 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:13.924439 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a59e2bdc-3954-488f-b4ad-ad4389a09021 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:13.925218 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a59e2bdc-3954-488f-b4ad-ad4389a09021 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:13.925688 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a59e2bdc-3954-488f-b4ad-ad4389a09021 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:13.926121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a59e2bdc-3954-488f-b4ad-ad4389a09021 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:14.578906 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-45250c60-f148-4b9c-8170-87348d98a31f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:14.579584 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-45250c60-f148-4b9c-8170-87348d98a31f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:14.586621 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-45250c60-f148-4b9c-8170-87348d98a31f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:14.593741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-45250c60-f148-4b9c-8170-87348d98a31f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:14.593741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-45250c60-f148-4b9c-8170-87348d98a31f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:14.593741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-45250c60-f148-4b9c-8170-87348d98a31f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:14.593741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-45250c60-f148-4b9c-8170-87348d98a31f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:14.594198 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-45250c60-f148-4b9c-8170-87348d98a31f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:14.741187 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-45250c60-f148-4b9c-8170-87348d98a31f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:14.752782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-45250c60-f148-4b9c-8170-87348d98a31f tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1673 microversion: 2.1 time: 0.177633 Aug 29 21:57:14.753766 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 468/946] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:14 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:57:15.078196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a59e2bdc-3954-488f-b4ad-ad4389a09021 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "POST /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.166663 Aug 29 21:57:15.078196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 479/947] 10.222.0.83 () {62 vars in 1364 bytes} [Mon Aug 29 21:57:13 2022] POST /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620/os-volume_attachments => generated 188 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 21:57:15.237289 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a3c79712-c297-4d99-94f5-c9b8950d1c9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:15.237992 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a3c79712-c297-4d99-94f5-c9b8950d1c9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:15.247407 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3c79712-c297-4d99-94f5-c9b8950d1c9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:15.248354 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3c79712-c297-4d99-94f5-c9b8950d1c9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:15.249284 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3c79712-c297-4d99-94f5-c9b8950d1c9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:15.250592 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3c79712-c297-4d99-94f5-c9b8950d1c9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:15.251435 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3c79712-c297-4d99-94f5-c9b8950d1c9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:15.252211 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3c79712-c297-4d99-94f5-c9b8950d1c9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:15.823392 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-296a3feb-2906-441f-b27d-bf57333ff7a9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:15.823392 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-296a3feb-2906-441f-b27d-bf57333ff7a9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:15.823392 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-296a3feb-2906-441f-b27d-bf57333ff7a9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:15.823392 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-296a3feb-2906-441f-b27d-bf57333ff7a9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:15.824032 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-296a3feb-2906-441f-b27d-bf57333ff7a9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:15.824032 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-296a3feb-2906-441f-b27d-bf57333ff7a9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:15.824032 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-296a3feb-2906-441f-b27d-bf57333ff7a9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:15.824032 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-296a3feb-2906-441f-b27d-bf57333ff7a9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:16.088084 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-296a3feb-2906-441f-b27d-bf57333ff7a9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:16.097625 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-296a3feb-2906-441f-b27d-bf57333ff7a9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1673 microversion: 2.1 time: 0.308465 Aug 29 21:57:16.113069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 480/948] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:15 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1673 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:16.511179 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a3c79712-c297-4d99-94f5-c9b8950d1c9d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620/os-volume_attachments/8d3ff49f-268a-4668-ac05-c125579baac5" status: 202 len: 0 microversion: 2.20 time: 1.279675 Aug 29 21:57:16.515098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 469/949] 10.222.0.83 () {60 vars in 1457 bytes} [Mon Aug 29 21:57:15 2022] DELETE /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620/os-volume_attachments/8d3ff49f-268a-4668-ac05-c125579baac5 => generated 0 bytes in 1285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:57:16.605362 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-3e69dfe5-09e7-4608-85e4-79778b86c49a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:16.606518 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3e69dfe5-09e7-4608-85e4-79778b86c49a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:16.613841 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3e69dfe5-09e7-4608-85e4-79778b86c49a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:16.614994 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3e69dfe5-09e7-4608-85e4-79778b86c49a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:16.615677 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3e69dfe5-09e7-4608-85e4-79778b86c49a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:16.616658 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3e69dfe5-09e7-4608-85e4-79778b86c49a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:16.617327 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3e69dfe5-09e7-4608-85e4-79778b86c49a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:16.618102 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3e69dfe5-09e7-4608-85e4-79778b86c49a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:16.799216 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3e69dfe5-09e7-4608-85e4-79778b86c49a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127882) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 21:57:16.917943 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-95a4e268-db0a-453d-a84c-dba13fbeae1b req-34a93f49-449e-45db-8d12-bb2cb814de01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aeae90c-192c-4d96-833e-2e4cdf0538f9", "name": "network-vif-deleted", "tag": "4adb0541-9c38-4289-8fb7-313fc3bc11be"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:16.930634 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-95a4e268-db0a-453d-a84c-dba13fbeae1b req-34a93f49-449e-45db-8d12-bb2cb814de01 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:16.933796 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-95a4e268-db0a-453d-a84c-dba13fbeae1b req-34a93f49-449e-45db-8d12-bb2cb814de01 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:16.933796 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-95a4e268-db0a-453d-a84c-dba13fbeae1b req-34a93f49-449e-45db-8d12-bb2cb814de01 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:16.945186 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-95a4e268-db0a-453d-a84c-dba13fbeae1b req-34a93f49-449e-45db-8d12-bb2cb814de01 service nova] Creating event network-vif-deleted:4adb0541-9c38-4289-8fb7-313fc3bc11be for instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 on hv-cinder-85426 Aug 29 21:57:16.950726 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-95a4e268-db0a-453d-a84c-dba13fbeae1b req-34a93f49-449e-45db-8d12-bb2cb814de01 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036949 Aug 29 21:57:16.956080 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 470/950] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:57:17.123656 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4c77ffe1-a9ec-488f-9cfa-3d715e095b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:17.124402 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4c77ffe1-a9ec-488f-9cfa-3d715e095b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:17.132585 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4c77ffe1-a9ec-488f-9cfa-3d715e095b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:17.143026 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4c77ffe1-a9ec-488f-9cfa-3d715e095b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:17.143026 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4c77ffe1-a9ec-488f-9cfa-3d715e095b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:17.143026 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4c77ffe1-a9ec-488f-9cfa-3d715e095b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:17.143026 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4c77ffe1-a9ec-488f-9cfa-3d715e095b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:17.143421 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4c77ffe1-a9ec-488f-9cfa-3d715e095b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:17.241208 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4c77ffe1-a9ec-488f-9cfa-3d715e095b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:17.254899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4c77ffe1-a9ec-488f-9cfa-3d715e095b7a tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1606 microversion: 2.1 time: 0.132525 Aug 29 21:57:17.264263 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 471/951] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:17 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1606 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:17.627849 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-3e69dfe5-09e7-4608-85e4-79778b86c49a tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "POST /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620/action" status: 202 len: 0 microversion: 2.20 time: 1.017884 Aug 29 21:57:17.627849 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 481/952] 10.222.0.83 () {62 vars in 1319 bytes} [Mon Aug 29 21:57:16 2022] POST /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620/action => generated 0 bytes in 1021 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:57:17.630405 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-eca1dfa1-74e9-437b-9966-605a2c5f7d0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:17.631521 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-eca1dfa1-74e9-437b-9966-605a2c5f7d0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:17.647588 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eca1dfa1-74e9-437b-9966-605a2c5f7d0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:17.648095 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eca1dfa1-74e9-437b-9966-605a2c5f7d0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:17.648573 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eca1dfa1-74e9-437b-9966-605a2c5f7d0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:17.652045 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eca1dfa1-74e9-437b-9966-605a2c5f7d0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:17.656325 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eca1dfa1-74e9-437b-9966-605a2c5f7d0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:17.656325 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eca1dfa1-74e9-437b-9966-605a2c5f7d0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:17.982290 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-eca1dfa1-74e9-437b-9966-605a2c5f7d0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:17.993372 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-eca1dfa1-74e9-437b-9966-605a2c5f7d0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:17.995272 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-eca1dfa1-74e9-437b-9966-605a2c5f7d0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:17.996756 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-eca1dfa1-74e9-437b-9966-605a2c5f7d0f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1673 microversion: 2.20 time: 0.370732 Aug 29 21:57:17.997815 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 472/953] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:17 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1673 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:18.283990 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f8dcfd5f-c2b5-4e6a-8705-ae01f6935d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:18.283990 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f8dcfd5f-c2b5-4e6a-8705-ae01f6935d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:18.288190 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f8dcfd5f-c2b5-4e6a-8705-ae01f6935d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:18.289109 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f8dcfd5f-c2b5-4e6a-8705-ae01f6935d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:18.289730 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f8dcfd5f-c2b5-4e6a-8705-ae01f6935d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:18.290868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f8dcfd5f-c2b5-4e6a-8705-ae01f6935d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:18.291772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f8dcfd5f-c2b5-4e6a-8705-ae01f6935d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:18.292429 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f8dcfd5f-c2b5-4e6a-8705-ae01f6935d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:18.315790 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:18.333871 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f8dcfd5f-c2b5-4e6a-8705-ae01f6935d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:18.334597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f8dcfd5f-c2b5-4e6a-8705-ae01f6935d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:18.335220 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f8dcfd5f-c2b5-4e6a-8705-ae01f6935d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:18.335960 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-f8dcfd5f-c2b5-4e6a-8705-ae01f6935d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lazy-loading 'fault' on Instance uuid 8aeae90c-192c-4d96-833e-2e4cdf0538f9 {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:57:18.409831 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f8dcfd5f-c2b5-4e6a-8705-ae01f6935d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8ef9f9eafd4248bae86f0e8ec72731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ce54651ad4326bccecbeea8b5b084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:18.421648 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f8dcfd5f-c2b5-4e6a-8705-ae01f6935d83 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 200 len: 1326 microversion: 2.1 time: 0.147692 Aug 29 21:57:18.432673 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 482/954] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:18 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 1326 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:19.019311 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-49541ea1-6cff-482e-98c6-dcf11a5c48e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:19.019922 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-49541ea1-6cff-482e-98c6-dcf11a5c48e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:19.028188 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-49541ea1-6cff-482e-98c6-dcf11a5c48e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:19.028738 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-49541ea1-6cff-482e-98c6-dcf11a5c48e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:19.029186 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-49541ea1-6cff-482e-98c6-dcf11a5c48e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:19.029900 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-49541ea1-6cff-482e-98c6-dcf11a5c48e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:19.030362 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-49541ea1-6cff-482e-98c6-dcf11a5c48e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:19.030793 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-49541ea1-6cff-482e-98c6-dcf11a5c48e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:19.182402 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-49541ea1-6cff-482e-98c6-dcf11a5c48e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:19.191022 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-49541ea1-6cff-482e-98c6-dcf11a5c48e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:19.192474 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-49541ea1-6cff-482e-98c6-dcf11a5c48e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:19.193720 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-49541ea1-6cff-482e-98c6-dcf11a5c48e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1673 microversion: 2.20 time: 0.178305 Aug 29 21:57:19.194284 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 473/955] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:19 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:57:19.445325 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ab8d09c0-108f-420e-b445-525b0d97c353 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:19.445927 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ab8d09c0-108f-420e-b445-525b0d97c353 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:19.452877 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ab8d09c0-108f-420e-b445-525b0d97c353 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:19.453388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ab8d09c0-108f-420e-b445-525b0d97c353 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:19.453823 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ab8d09c0-108f-420e-b445-525b0d97c353 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:19.454555 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ab8d09c0-108f-420e-b445-525b0d97c353 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:19.455011 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ab8d09c0-108f-420e-b445-525b0d97c353 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:19.455428 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ab8d09c0-108f-420e-b445-525b0d97c353 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:19.469620 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-ab8d09c0-108f-420e-b445-525b0d97c353 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] HTTP exception thrown: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ab8d09c0-108f-420e-b445-525b0d97c353 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Request method failure captured: Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 HTTP/1.1 Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTSxxfRUI7l52of29zB3ZslHUdBQFJCfPXD0NWyt1ueGx_jVZKX4tfkmalYN2PfXJ8Fh_NLar_HSQW2MuxynwdF8Njj5tPSbFDgAiOY7LFxpbZ54ghTWDY5nkh7JRhPPIuTEShd0Pq6q6a6B2kB6mswBb8y6iSMXHKEOcdbAM38Llm8 Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: d45ce54651ad4326bccecbeea8b5b084 Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:57:19.471154 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:57:19.472818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:57:19.472818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:57:19.472818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: d45ce54651ad4326bccecbeea8b5b084 Aug 29 21:57:19.472818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:57:19.472818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeTestJSON-644969764-project Aug 29 21:57:19.472818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:57:19.472818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:57:19.472818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: ed8ef9f9eafd4248bae86f0e8ec72731 Aug 29 21:57:19.472818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeTestJSON-644969764-project Aug 29 21:57:19.472818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:57:19.472818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. Aug 29 21:57:19.472818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '8aeae90c-192c-4d96-833e-2e4cdf0538f9'} Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:57:19.473875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. Aug 29 21:57:19.476225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:19.477935 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ab8d09c0-108f-420e-b445-525b0d97c353 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Returning 404 to user: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:57:19.477935 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ab8d09c0-108f-420e-b445-525b0d97c353 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 404 len: 111 microversion: 2.1 time: 0.031632 Aug 29 21:57:19.477935 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 483/956] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:19 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:57:19.482145 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-52d41379-16cd-45b2-bb28-f593ba4edd43 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '.version_select at 0x7f5040682040>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:19.630374 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-52d41379-16cd-45b2-bb28-f593ba4edd43 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-641637025" status: 202 len: 0 microversion: 2.1 time: 0.151987 Aug 29 21:57:19.632653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 474/957] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 21:57:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-641637025 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:57:20.216534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-94397afa-cb14-4cde-9892-c2522e558dbd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:20.217134 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-94397afa-cb14-4cde-9892-c2522e558dbd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:20.226469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94397afa-cb14-4cde-9892-c2522e558dbd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:20.227006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94397afa-cb14-4cde-9892-c2522e558dbd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:20.227443 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94397afa-cb14-4cde-9892-c2522e558dbd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:20.228332 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94397afa-cb14-4cde-9892-c2522e558dbd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:20.229110 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94397afa-cb14-4cde-9892-c2522e558dbd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:20.229745 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94397afa-cb14-4cde-9892-c2522e558dbd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:20.377408 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-94397afa-cb14-4cde-9892-c2522e558dbd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:20.386296 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-94397afa-cb14-4cde-9892-c2522e558dbd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:20.387909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-94397afa-cb14-4cde-9892-c2522e558dbd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:20.389120 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-94397afa-cb14-4cde-9892-c2522e558dbd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1731 microversion: 2.20 time: 0.176568 Aug 29 21:57:20.389675 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 484/958] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:20 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:57:21.419916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-3cc51b0a-4fb7-48eb-96dc-e191dd7c721b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:21.420914 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-3cc51b0a-4fb7-48eb-96dc-e191dd7c721b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:21.429108 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3cc51b0a-4fb7-48eb-96dc-e191dd7c721b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:21.429604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3cc51b0a-4fb7-48eb-96dc-e191dd7c721b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:21.430049 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3cc51b0a-4fb7-48eb-96dc-e191dd7c721b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:21.430772 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3cc51b0a-4fb7-48eb-96dc-e191dd7c721b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:21.431241 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3cc51b0a-4fb7-48eb-96dc-e191dd7c721b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:21.431725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3cc51b0a-4fb7-48eb-96dc-e191dd7c721b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:21.635759 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-3cc51b0a-4fb7-48eb-96dc-e191dd7c721b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:21.637209 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-3cc51b0a-4fb7-48eb-96dc-e191dd7c721b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:21.638755 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-3cc51b0a-4fb7-48eb-96dc-e191dd7c721b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:21.640027 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-3cc51b0a-4fb7-48eb-96dc-e191dd7c721b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1731 microversion: 2.20 time: 0.227272 Aug 29 21:57:21.640611 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 475/959] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:21 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1731 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:22.668039 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-45070cfa-f5cc-438b-9bb9-3ed937870837 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:22.669305 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-45070cfa-f5cc-438b-9bb9-3ed937870837 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:22.695431 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-45070cfa-f5cc-438b-9bb9-3ed937870837 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:22.700810 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-45070cfa-f5cc-438b-9bb9-3ed937870837 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:22.704099 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-45070cfa-f5cc-438b-9bb9-3ed937870837 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:22.706388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-45070cfa-f5cc-438b-9bb9-3ed937870837 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:22.707295 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-45070cfa-f5cc-438b-9bb9-3ed937870837 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:22.708548 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-45070cfa-f5cc-438b-9bb9-3ed937870837 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:22.892348 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-45070cfa-f5cc-438b-9bb9-3ed937870837 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:22.905712 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-45070cfa-f5cc-438b-9bb9-3ed937870837 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:22.907776 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-45070cfa-f5cc-438b-9bb9-3ed937870837 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:22.909375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-45070cfa-f5cc-438b-9bb9-3ed937870837 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1731 microversion: 2.20 time: 0.249104 Aug 29 21:57:22.914724 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 485/960] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:22 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1731 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:23.409630 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6892e449-5f51-4a9a-a773-6b9073b9120e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:23.411019 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-6892e449-5f51-4a9a-a773-6b9073b9120e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:23.423138 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6892e449-5f51-4a9a-a773-6b9073b9120e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:23.423138 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6892e449-5f51-4a9a-a773-6b9073b9120e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:23.423138 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6892e449-5f51-4a9a-a773-6b9073b9120e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:23.423599 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6892e449-5f51-4a9a-a773-6b9073b9120e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:23.423994 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6892e449-5f51-4a9a-a773-6b9073b9120e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:23.424807 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-6892e449-5f51-4a9a-a773-6b9073b9120e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:23.444125 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-6892e449-5f51-4a9a-a773-6b9073b9120e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] HTTP exception thrown: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6892e449-5f51-4a9a-a773-6b9073b9120e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Request method failure captured: Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: DELETE /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 HTTP/1.1 Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTSxxfRUI7l52of29zB3ZslHUdBQFJCfPXD0NWyt1ueGx_jVZKX4tfkmalYN2PfXJ8Fh_NLar_HSQW2MuxynwdF8Njj5tPSbFDgAiOY7LFxpbZ54ghTWDY5nkh7JRhPPIuTEShd0Pq6q6a6B2kB6mswBb8y6iSMXHKEOcdbAM38Llm8 Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: d45ce54651ad4326bccecbeea8b5b084 Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 21:57:23.446594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 21:57:23.454137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:57:23.454137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:57:23.454137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: d45ce54651ad4326bccecbeea8b5b084 Aug 29 21:57:23.454137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:57:23.454137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-AttachVolumeTestJSON-644969764-project Aug 29 21:57:23.454137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 21:57:23.454137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 21:57:23.454137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: ed8ef9f9eafd4248bae86f0e8ec72731 Aug 29 21:57:23.454137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-AttachVolumeTestJSON-644969764-project Aug 29 21:57:23.454137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 21:57:23.454137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. Aug 29 21:57:23.454137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': '8aeae90c-192c-4d96-833e-2e4cdf0538f9'} Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:57:23.455070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. Aug 29 21:57:23.456674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:23.458373 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-6892e449-5f51-4a9a-a773-6b9073b9120e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Returning 404 to user: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:57:23.458373 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-6892e449-5f51-4a9a-a773-6b9073b9120e tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 404 len: 111 microversion: 2.1 time: 0.046695 Aug 29 21:57:23.458373 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 476/961] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:57:23 2022] DELETE /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:57:23.462107 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-94eec309-2d9b-43ff-ade7-93122497da9b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:23.463001 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-94eec309-2d9b-43ff-ade7-93122497da9b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 8aeae90c-192c-4d96-833e-2e4cdf0538f9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:23.470384 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94eec309-2d9b-43ff-ade7-93122497da9b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:23.470981 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94eec309-2d9b-43ff-ade7-93122497da9b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:23.471457 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94eec309-2d9b-43ff-ade7-93122497da9b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:23.472227 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94eec309-2d9b-43ff-ade7-93122497da9b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:23.472720 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94eec309-2d9b-43ff-ade7-93122497da9b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:23.473467 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-94eec309-2d9b-43ff-ade7-93122497da9b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:23.492712 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-94eec309-2d9b-43ff-ade7-93122497da9b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] HTTP exception thrown: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-94eec309-2d9b-43ff-ade7-93122497da9b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Request method failure captured: Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 HTTP/1.1 Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTSxxfRUI7l52of29zB3ZslHUdBQFJCfPXD0NWyt1ueGx_jVZKX4tfkmalYN2PfXJ8Fh_NLar_HSQW2MuxynwdF8Njj5tPSbFDgAiOY7LFxpbZ54ghTWDY5nkh7JRhPPIuTEShd0Pq6q6a6B2kB6mswBb8y6iSMXHKEOcdbAM38Llm8 Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: d45ce54651ad4326bccecbeea8b5b084 Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:57:23.494729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:57:23.496534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:57:23.496534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:57:23.496534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: d45ce54651ad4326bccecbeea8b5b084 Aug 29 21:57:23.496534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:57:23.496534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeTestJSON-644969764-project Aug 29 21:57:23.496534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:57:23.496534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:57:23.496534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: ed8ef9f9eafd4248bae86f0e8ec72731 Aug 29 21:57:23.496534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeTestJSON-644969764-project Aug 29 21:57:23.496534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:57:23.496534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. Aug 29 21:57:23.496534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '8aeae90c-192c-4d96-833e-2e4cdf0538f9'} Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:57:23.497466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. Aug 29 21:57:23.498756 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:23.500991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-94eec309-2d9b-43ff-ade7-93122497da9b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Returning 404 to user: Instance 8aeae90c-192c-4d96-833e-2e4cdf0538f9 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:57:23.502241 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-94eec309-2d9b-43ff-ade7-93122497da9b tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9" status: 404 len: 111 microversion: 2.1 time: 0.047312 Aug 29 21:57:23.503373 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 486/962] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:23 2022] GET /compute/v2.1/servers/8aeae90c-192c-4d96-833e-2e4cdf0538f9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:57:23.935319 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4e23e73b-32ee-40a3-99be-392e50ca200d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:23.936270 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4e23e73b-32ee-40a3-99be-392e50ca200d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:23.948406 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e23e73b-32ee-40a3-99be-392e50ca200d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:23.949483 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e23e73b-32ee-40a3-99be-392e50ca200d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:23.950292 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e23e73b-32ee-40a3-99be-392e50ca200d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:23.952515 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e23e73b-32ee-40a3-99be-392e50ca200d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:23.953327 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e23e73b-32ee-40a3-99be-392e50ca200d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:23.954866 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e23e73b-32ee-40a3-99be-392e50ca200d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:24.247453 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4e23e73b-32ee-40a3-99be-392e50ca200d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:24.259469 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4e23e73b-32ee-40a3-99be-392e50ca200d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:24.263813 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4e23e73b-32ee-40a3-99be-392e50ca200d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:24.270729 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4e23e73b-32ee-40a3-99be-392e50ca200d tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1731 microversion: 2.20 time: 0.339751 Aug 29 21:57:24.287929 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 477/963] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:23 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1731 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:24.945414 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a91d5e8e-3a7a-451e-93b8-bd27070335f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:24.946517 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a91d5e8e-3a7a-451e-93b8-bd27070335f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:24.974621 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a91d5e8e-3a7a-451e-93b8-bd27070335f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:24.981482 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a91d5e8e-3a7a-451e-93b8-bd27070335f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:24.982304 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a91d5e8e-3a7a-451e-93b8-bd27070335f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:24.983296 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a91d5e8e-3a7a-451e-93b8-bd27070335f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:24.983980 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a91d5e8e-3a7a-451e-93b8-bd27070335f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:24.984796 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a91d5e8e-3a7a-451e-93b8-bd27070335f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:25.031601 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-a91d5e8e-3a7a-451e-93b8-bd27070335f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] HTTP exception thrown: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a91d5e8e-3a7a-451e-93b8-bd27070335f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Request method failure captured: Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: DELETE /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 HTTP/1.1 Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTSxxfRUI7l52of29zB3ZslHUdBQFJCfPXD0NWyt1ueGx_jVZKX4tfkmalYN2PfXJ8Fh_NLar_HSQW2MuxynwdF8Njj5tPSbFDgAiOY7LFxpbZ54ghTWDY5nkh7JRhPPIuTEShd0Pq6q6a6B2kB6mswBb8y6iSMXHKEOcdbAM38Llm8 Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: d45ce54651ad4326bccecbeea8b5b084 Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:57:25.036046 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:57:25.038844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:57:25.038844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:57:25.038844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: d45ce54651ad4326bccecbeea8b5b084 Aug 29 21:57:25.038844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:57:25.038844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeTestJSON-644969764-project Aug 29 21:57:25.038844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:57:25.038844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:57:25.038844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: ed8ef9f9eafd4248bae86f0e8ec72731 Aug 29 21:57:25.038844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeTestJSON-644969764-project Aug 29 21:57:25.038844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:57:25.038844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. Aug 29 21:57:25.038844 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '93cc4db2-465f-41c0-8689-d78cccae7601'} Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:57:25.040209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. Aug 29 21:57:25.045985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:25.050909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a91d5e8e-3a7a-451e-93b8-bd27070335f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Returning 404 to user: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:57:25.050909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a91d5e8e-3a7a-451e-93b8-bd27070335f9 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "DELETE /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 404 len: 111 microversion: 2.1 time: 0.104974 Aug 29 21:57:25.050909 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 487/964] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:57:24 2022] DELETE /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 21:57:25.051624 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f9133576-ebd9-41c0-9eea-dbe4fde13913 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:25.052653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f9133576-ebd9-41c0-9eea-dbe4fde13913 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] [instance: 93cc4db2-465f-41c0-8689-d78cccae7601] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:25.066780 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9133576-ebd9-41c0-9eea-dbe4fde13913 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:25.067242 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9133576-ebd9-41c0-9eea-dbe4fde13913 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:25.067548 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9133576-ebd9-41c0-9eea-dbe4fde13913 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:25.089923 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9133576-ebd9-41c0-9eea-dbe4fde13913 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:25.091952 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9133576-ebd9-41c0-9eea-dbe4fde13913 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:25.093268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9133576-ebd9-41c0-9eea-dbe4fde13913 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:25.151541 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-f9133576-ebd9-41c0-9eea-dbe4fde13913 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] HTTP exception thrown: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f9133576-ebd9-41c0-9eea-dbe4fde13913 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Request method failure captured: Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 HTTP/1.1 Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTSxxfRUI7l52of29zB3ZslHUdBQFJCfPXD0NWyt1ueGx_jVZKX4tfkmalYN2PfXJ8Fh_NLar_HSQW2MuxynwdF8Njj5tPSbFDgAiOY7LFxpbZ54ghTWDY5nkh7JRhPPIuTEShd0Pq6q6a6B2kB6mswBb8y6iSMXHKEOcdbAM38Llm8 Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: d45ce54651ad4326bccecbeea8b5b084 Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 21:57:25.159091 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 21:57:25.160568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/d45ce54651ad4326bccecbeea8b5b084"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:57:25.160568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:57:25.160568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: d45ce54651ad4326bccecbeea8b5b084 Aug 29 21:57:25.160568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-AttachVolumeTestJSON-644969764 Aug 29 21:57:25.160568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-AttachVolumeTestJSON-644969764-project Aug 29 21:57:25.160568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 21:57:25.160568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 21:57:25.160568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: ed8ef9f9eafd4248bae86f0e8ec72731 Aug 29 21:57:25.160568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-AttachVolumeTestJSON-644969764-project Aug 29 21:57:25.160568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 21:57:25.160568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. Aug 29 21:57:25.160568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': '93cc4db2-465f-41c0-8689-d78cccae7601'} Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:57:25.161490 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. Aug 29 21:57:25.163098 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:25.166332 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f9133576-ebd9-41c0-9eea-dbe4fde13913 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] Returning 404 to user: Instance 93cc4db2-465f-41c0-8689-d78cccae7601 could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:57:25.166332 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f9133576-ebd9-41c0-9eea-dbe4fde13913 tempest-AttachVolumeTestJSON-644969764 tempest-AttachVolumeTestJSON-644969764-project] 10.222.0.83 "GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601" status: 404 len: 111 microversion: 2.1 time: 0.111998 Aug 29 21:57:25.166767 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 478/965] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:25 2022] GET /compute/v2.1/servers/93cc4db2-465f-41c0-8689-d78cccae7601 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:57:25.294359 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-3611e435-d5be-4ea3-81fe-c37247df2620 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:25.294987 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3611e435-d5be-4ea3-81fe-c37247df2620 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:25.304804 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3611e435-d5be-4ea3-81fe-c37247df2620 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:25.305291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3611e435-d5be-4ea3-81fe-c37247df2620 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:25.305739 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3611e435-d5be-4ea3-81fe-c37247df2620 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:25.306483 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3611e435-d5be-4ea3-81fe-c37247df2620 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:25.306932 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3611e435-d5be-4ea3-81fe-c37247df2620 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:25.307367 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3611e435-d5be-4ea3-81fe-c37247df2620 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:25.966829 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-3611e435-d5be-4ea3-81fe-c37247df2620 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:25.982445 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-3611e435-d5be-4ea3-81fe-c37247df2620 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:25.993106 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-3611e435-d5be-4ea3-81fe-c37247df2620 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:25.994778 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-3611e435-d5be-4ea3-81fe-c37247df2620 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1731 microversion: 2.20 time: 0.704528 Aug 29 21:57:26.011946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 488/966] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:25 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1731 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:27.042539 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-867e5838-97df-47d4-a57a-5366bdf7c547 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:27.047764 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-867e5838-97df-47d4-a57a-5366bdf7c547 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:27.077601 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-867e5838-97df-47d4-a57a-5366bdf7c547 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:27.078767 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-867e5838-97df-47d4-a57a-5366bdf7c547 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:27.080429 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-867e5838-97df-47d4-a57a-5366bdf7c547 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:27.081865 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-867e5838-97df-47d4-a57a-5366bdf7c547 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:27.082864 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-867e5838-97df-47d4-a57a-5366bdf7c547 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:27.083996 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-867e5838-97df-47d4-a57a-5366bdf7c547 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:27.960451 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-867e5838-97df-47d4-a57a-5366bdf7c547 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:27.976302 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-867e5838-97df-47d4-a57a-5366bdf7c547 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:27.978689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-867e5838-97df-47d4-a57a-5366bdf7c547 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:27.980135 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-867e5838-97df-47d4-a57a-5366bdf7c547 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1731 microversion: 2.20 time: 0.960663 Aug 29 21:57:27.997223 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 479/967] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:27 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1731 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:29.010754 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e7db996a-4c7f-474b-b825-24d5ac3214e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:29.012079 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-e7db996a-4c7f-474b-b825-24d5ac3214e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:29.040050 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e7db996a-4c7f-474b-b825-24d5ac3214e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:29.040920 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e7db996a-4c7f-474b-b825-24d5ac3214e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:29.050414 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e7db996a-4c7f-474b-b825-24d5ac3214e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:29.051947 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e7db996a-4c7f-474b-b825-24d5ac3214e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:29.053175 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e7db996a-4c7f-474b-b825-24d5ac3214e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:29.053906 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e7db996a-4c7f-474b-b825-24d5ac3214e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:29.606664 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e7db996a-4c7f-474b-b825-24d5ac3214e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:29.626073 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e7db996a-4c7f-474b-b825-24d5ac3214e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:29.635184 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e7db996a-4c7f-474b-b825-24d5ac3214e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:29.637045 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e7db996a-4c7f-474b-b825-24d5ac3214e3 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1731 microversion: 2.20 time: 0.632483 Aug 29 21:57:29.638956 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 489/968] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:29 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1731 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:30.670297 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b807152a-dc00-4846-801d-cbe96c92a876 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:30.676269 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b807152a-dc00-4846-801d-cbe96c92a876 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:30.695858 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b807152a-dc00-4846-801d-cbe96c92a876 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:30.696643 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b807152a-dc00-4846-801d-cbe96c92a876 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:30.698627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b807152a-dc00-4846-801d-cbe96c92a876 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:30.700868 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b807152a-dc00-4846-801d-cbe96c92a876 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:30.701476 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b807152a-dc00-4846-801d-cbe96c92a876 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:30.702270 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b807152a-dc00-4846-801d-cbe96c92a876 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:31.089826 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b807152a-dc00-4846-801d-cbe96c92a876 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:31.111981 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b807152a-dc00-4846-801d-cbe96c92a876 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:31.115604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-b807152a-dc00-4846-801d-cbe96c92a876 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:31.117764 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b807152a-dc00-4846-801d-cbe96c92a876 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1731 microversion: 2.20 time: 0.454465 Aug 29 21:57:31.118653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 480/969] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:30 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1731 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:31.661157 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f3ea1616-8c3e-496c-8f53-383323b4e072 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Action: 'create', calling method: .version_select at 0x7f50406abc10>, body: {"keypair": {"name": "tempest-keypair-1300980635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0uRQ6ZJwtNJpKv72UNlGDRlETaPL3VV3R8DRzPMztjWD2k2cEVGp6XGc2th2lsQmBxYG4xltzCmwbtDjUTeZbtpk9/qaKshkcqfiOk4q8WH5PkzBz1uCngc22TA0E8mQ=="}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:31.692314 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-f3ea1616-8c3e-496c-8f53-383323b4e072 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for project 926837c28a3743deab8a4849571ecd19. Resources: {'key_pairs'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:57:31.710785 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-f3ea1616-8c3e-496c-8f53-383323b4e072 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for user 3a878450743f4843a5e8cc04ca94184d and project 926837c28a3743deab8a4849571ecd19. Resources: {'key_pairs'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:57:31.881956 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f3ea1616-8c3e-496c-8f53-383323b4e072 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.401939 Aug 29 21:57:31.884598 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 490/970] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 21:57:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:57:32.153644 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-10ac377f-fe86-43ef-a162-afbc42cdbde5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:32.155011 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-10ac377f-fe86-43ef-a162-afbc42cdbde5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:32.162830 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10ac377f-fe86-43ef-a162-afbc42cdbde5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:32.163706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10ac377f-fe86-43ef-a162-afbc42cdbde5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:32.164421 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10ac377f-fe86-43ef-a162-afbc42cdbde5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:32.165347 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10ac377f-fe86-43ef-a162-afbc42cdbde5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:32.166073 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10ac377f-fe86-43ef-a162-afbc42cdbde5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:32.166854 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-10ac377f-fe86-43ef-a162-afbc42cdbde5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:32.468156 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-10ac377f-fe86-43ef-a162-afbc42cdbde5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:32.474989 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-10ac377f-fe86-43ef-a162-afbc42cdbde5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:32.476638 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-10ac377f-fe86-43ef-a162-afbc42cdbde5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:32.478567 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-10ac377f-fe86-43ef-a162-afbc42cdbde5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1731 microversion: 2.20 time: 0.328421 Aug 29 21:57:32.491971 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 481/971] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:32 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1731 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:33.504850 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f2b0246c-ed78-4941-9bff-954e4813bedf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:33.505675 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f2b0246c-ed78-4941-9bff-954e4813bedf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:33.523047 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f2b0246c-ed78-4941-9bff-954e4813bedf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:33.523835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f2b0246c-ed78-4941-9bff-954e4813bedf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:33.524623 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f2b0246c-ed78-4941-9bff-954e4813bedf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:33.525646 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f2b0246c-ed78-4941-9bff-954e4813bedf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:33.526408 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f2b0246c-ed78-4941-9bff-954e4813bedf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:33.527061 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f2b0246c-ed78-4941-9bff-954e4813bedf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:33.716576 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f2b0246c-ed78-4941-9bff-954e4813bedf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:33.728602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f2b0246c-ed78-4941-9bff-954e4813bedf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:33.743023 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f2b0246c-ed78-4941-9bff-954e4813bedf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:33.743023 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f2b0246c-ed78-4941-9bff-954e4813bedf tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1731 microversion: 2.20 time: 0.233549 Aug 29 21:57:33.743023 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 491/972] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:33 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:34.658536 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-760cabe3-7ca7-4d62-abca-b1db085ba014 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-12098238"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:34.660454 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-760cabe3-7ca7-4d62-abca-b1db085ba014 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:34.670745 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-760cabe3-7ca7-4d62-abca-b1db085ba014 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:34.673623 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-760cabe3-7ca7-4d62-abca-b1db085ba014 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:34.674137 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-760cabe3-7ca7-4d62-abca-b1db085ba014 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:34.675158 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-760cabe3-7ca7-4d62-abca-b1db085ba014 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:34.675789 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-760cabe3-7ca7-4d62-abca-b1db085ba014 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:34.680025 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-760cabe3-7ca7-4d62-abca-b1db085ba014 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:34.755983 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-1ed86601-acd8-4cda-b15f-2695ce884bc4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:34.757311 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-1ed86601-acd8-4cda-b15f-2695ce884bc4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:34.765383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1ed86601-acd8-4cda-b15f-2695ce884bc4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:34.766018 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1ed86601-acd8-4cda-b15f-2695ce884bc4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:34.766398 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1ed86601-acd8-4cda-b15f-2695ce884bc4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:34.767316 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1ed86601-acd8-4cda-b15f-2695ce884bc4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:34.767771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1ed86601-acd8-4cda-b15f-2695ce884bc4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:34.768271 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1ed86601-acd8-4cda-b15f-2695ce884bc4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:34.999630 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.network.security_group_api [None req-760cabe3-7ca7-4d62-abca-b1db085ba014 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Removing security group 5567bf31-3e0d-447c-b877-03fe64191627 from port b88a29b5-ab90-482e-8b10-2c1389ed5c8b Aug 29 21:57:35.017021 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1ed86601-acd8-4cda-b15f-2695ce884bc4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:35.030686 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1ed86601-acd8-4cda-b15f-2695ce884bc4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:35.032905 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1ed86601-acd8-4cda-b15f-2695ce884bc4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:35.034184 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-1ed86601-acd8-4cda-b15f-2695ce884bc4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1731 microversion: 2.20 time: 0.283067 Aug 29 21:57:35.035582 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 492/973] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:34 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1731 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 21:57:35.486317 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1800808966", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffd5a48c-ee26-4008-a0d2-7fefac315aca"}], "security_groups": [{"name": "tempest-securitygroup--177117063"}], "key_name": "tempest-keypair-1300980635", "user_data": "}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:35.618849 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-760cabe3-7ca7-4d62-abca-b1db085ba014 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "POST /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/action" status: 202 len: 0 microversion: 2.1 time: 0.963870 Aug 29 21:57:35.620937 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 482/974] 10.222.0.83 () {60 vars in 1278 bytes} [Mon Aug 29 21:57:34 2022] POST /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/action => generated 0 bytes in 967 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:57:35.638700 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.network.neutron [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] validate_networks() for [('ffd5a48c-ee26-4008-a0d2-7fefac315aca', None, None, None, None, None)] {{(pid=127882) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:57:35.653280 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-d6427bb0-aa61-4990-9524-d4ae33b36946 req-d39f542d-7a3b-4020-852e-3c97009e4508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9b91c1-cfde-4d81-ac00-b83f8b333df9", "tag": "b88a29b5-ab90-482e-8b10-2c1389ed5c8b"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:35.669295 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-d6427bb0-aa61-4990-9524-d4ae33b36946 req-d39f542d-7a3b-4020-852e-3c97009e4508 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:35.670833 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-d6427bb0-aa61-4990-9524-d4ae33b36946 req-d39f542d-7a3b-4020-852e-3c97009e4508 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:35.671612 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-d6427bb0-aa61-4990-9524-d4ae33b36946 req-d39f542d-7a3b-4020-852e-3c97009e4508 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:35.678426 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:35.696988 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-d6427bb0-aa61-4990-9524-d4ae33b36946 req-d39f542d-7a3b-4020-852e-3c97009e4508 service nova] Creating event network-changed:b88a29b5-ab90-482e-8b10-2c1389ed5c8b for instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 on hv-cinder-85426 Aug 29 21:57:35.703238 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-d6427bb0-aa61-4990-9524-d4ae33b36946 req-d39f542d-7a3b-4020-852e-3c97009e4508 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058380 Aug 29 21:57:35.704227 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 483/975] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:57:36.060691 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4e25ac52-04ca-4037-a2c8-2484dc2304bd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:36.061736 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4e25ac52-04ca-4037-a2c8-2484dc2304bd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:36.075344 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e25ac52-04ca-4037-a2c8-2484dc2304bd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:36.080361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e25ac52-04ca-4037-a2c8-2484dc2304bd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:36.081211 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e25ac52-04ca-4037-a2c8-2484dc2304bd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:36.081990 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e25ac52-04ca-4037-a2c8-2484dc2304bd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:36.082468 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e25ac52-04ca-4037-a2c8-2484dc2304bd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:36.082909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4e25ac52-04ca-4037-a2c8-2484dc2304bd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:36.473453 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Flavor limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:57:36.473968 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Image limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:57:36.474920 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Flavor pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:57:36.475339 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Image pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:57:36.475818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:57:36.492657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:36.493165 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:36.496927 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:36.497768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:36.505110 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:36.505994 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:36.539205 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for project 926837c28a3743deab8a4849571ecd19. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:57:36.541635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4e25ac52-04ca-4037-a2c8-2484dc2304bd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:36.546732 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for user 3a878450743f4843a5e8cc04ca94184d and project 926837c28a3743deab8a4849571ecd19. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:57:36.555335 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4e25ac52-04ca-4037-a2c8-2484dc2304bd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:36.559828 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4e25ac52-04ca-4037-a2c8-2484dc2304bd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:36.562663 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4e25ac52-04ca-4037-a2c8-2484dc2304bd tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1731 microversion: 2.20 time: 0.506887 Aug 29 21:57:36.565473 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 484/976] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:36 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1731 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:36.582972 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Going to run 1 instances... {{(pid=127882) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:57:36.586814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127882) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:57:36.737246 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-ffb6e93c-dd1f-4d53-97f9-b86659c3765a req-2813f053-95e7-44e4-b19b-69ca3f9cf108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01db998-129a-4b44-a3c4-1da1bf023620", "name": "network-vif-plugged", "status": "completed", "tag": "95ba8615-923a-46f1-ae70-f15459156d2b"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:36.753981 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-ffb6e93c-dd1f-4d53-97f9-b86659c3765a req-2813f053-95e7-44e4-b19b-69ca3f9cf108 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:36.754930 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-ffb6e93c-dd1f-4d53-97f9-b86659c3765a req-2813f053-95e7-44e4-b19b-69ca3f9cf108 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:36.756414 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-ffb6e93c-dd1f-4d53-97f9-b86659c3765a req-2813f053-95e7-44e4-b19b-69ca3f9cf108 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:36.774525 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-ffb6e93c-dd1f-4d53-97f9-b86659c3765a req-2813f053-95e7-44e4-b19b-69ca3f9cf108 service nova] Creating event network-vif-plugged:95ba8615-923a-46f1-ae70-f15459156d2b for instance d01db998-129a-4b44-a3c4-1da1bf023620 on hv-cinder-85426 Aug 29 21:57:36.780184 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-ffb6e93c-dd1f-4d53-97f9-b86659c3765a req-2813f053-95e7-44e4-b19b-69ca3f9cf108 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046736 Aug 29 21:57:36.781896 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 485/977] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:57:36.817452 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d4b9e214-716a-43ae-b06b-07bd778e478e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.336848 Aug 29 21:57:36.819298 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 493/978] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:57:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:57:36.834435 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-348012f6-893c-4ee7-b546-90385842ca1e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:36.837541 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-348012f6-893c-4ee7-b546-90385842ca1e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:36.930556 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-348012f6-893c-4ee7-b546-90385842ca1e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:36.940833 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-348012f6-893c-4ee7-b546-90385842ca1e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1242 microversion: 2.1 time: 0.112572 Aug 29 21:57:36.942101 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 486/979] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:36 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1242 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:37.584268 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-81aa6e03-5b62-4ddb-a470-2460eafebeb5 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:37.592360 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-81aa6e03-5b62-4ddb-a470-2460eafebeb5 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:37.594666 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:37.596592 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81aa6e03-5b62-4ddb-a470-2460eafebeb5 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:37.597118 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81aa6e03-5b62-4ddb-a470-2460eafebeb5 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:37.597565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81aa6e03-5b62-4ddb-a470-2460eafebeb5 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:37.598312 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81aa6e03-5b62-4ddb-a470-2460eafebeb5 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:37.598994 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81aa6e03-5b62-4ddb-a470-2460eafebeb5 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:37.600086 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-81aa6e03-5b62-4ddb-a470-2460eafebeb5 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:37.700220 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-81aa6e03-5b62-4ddb-a470-2460eafebeb5 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lazy-loading 'services' on Instance uuid 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:57:37.783658 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-be8b8971-d0c8-4d65-a681-f20a6f1475a0 req-ac8a8317-64b4-43d0-ae55-c3c4c0c41ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9b91c1-cfde-4d81-ac00-b83f8b333df9", "tag": "b88a29b5-ab90-482e-8b10-2c1389ed5c8b"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:37.797349 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-be8b8971-d0c8-4d65-a681-f20a6f1475a0 req-ac8a8317-64b4-43d0-ae55-c3c4c0c41ea5 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:37.806216 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-be8b8971-d0c8-4d65-a681-f20a6f1475a0 req-ac8a8317-64b4-43d0-ae55-c3c4c0c41ea5 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:37.806696 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-be8b8971-d0c8-4d65-a681-f20a6f1475a0 req-ac8a8317-64b4-43d0-ae55-c3c4c0c41ea5 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:37.822546 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-be8b8971-d0c8-4d65-a681-f20a6f1475a0 req-ac8a8317-64b4-43d0-ae55-c3c4c0c41ea5 service nova] Creating event network-changed:b88a29b5-ab90-482e-8b10-2c1389ed5c8b for instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 on hv-cinder-85426 Aug 29 21:57:37.828312 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-be8b8971-d0c8-4d65-a681-f20a6f1475a0 req-ac8a8317-64b4-43d0-ae55-c3c4c0c41ea5 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.254660 Aug 29 21:57:37.829283 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 487/980] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:57:37.835256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-be702aeb-5adb-4c30-be88-758c47435bf6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:37.836014 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-be702aeb-5adb-4c30-be88-758c47435bf6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:37.842777 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be702aeb-5adb-4c30-be88-758c47435bf6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:37.843307 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be702aeb-5adb-4c30-be88-758c47435bf6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:37.844045 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be702aeb-5adb-4c30-be88-758c47435bf6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:37.844927 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be702aeb-5adb-4c30-be88-758c47435bf6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:37.845651 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be702aeb-5adb-4c30-be88-758c47435bf6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:37.846090 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-be702aeb-5adb-4c30-be88-758c47435bf6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:38.003377 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-be702aeb-5adb-4c30-be88-758c47435bf6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:38.015691 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-be702aeb-5adb-4c30-be88-758c47435bf6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:38.017516 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-be702aeb-5adb-4c30-be88-758c47435bf6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:38.019641 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-be702aeb-5adb-4c30-be88-758c47435bf6 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1731 microversion: 2.20 time: 0.188915 Aug 29 21:57:38.032801 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-81aa6e03-5b62-4ddb-a470-2460eafebeb5 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/os-volume_attachments/bb20a5f9-e4e2-4916-b3c6-cdc94b7dad0a" status: 202 len: 0 microversion: 2.1 time: 0.458386 Aug 29 21:57:38.033211 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 494/981] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 21:57:37 2022] DELETE /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/os-volume_attachments/bb20a5f9-e4e2-4916-b3c6-cdc94b7dad0a => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 21:57:38.037690 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 488/982] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:37 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:38.042015 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-aa7b461b-f7ae-4656-b653-8b64b40a8901 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:38.042925 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-aa7b461b-f7ae-4656-b653-8b64b40a8901 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:38.043070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-622835a2-ebc8-441a-87bb-a52cbb831199 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:38.045560 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-622835a2-ebc8-441a-87bb-a52cbb831199 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:38.063254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-622835a2-ebc8-441a-87bb-a52cbb831199 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:38.064149 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-622835a2-ebc8-441a-87bb-a52cbb831199 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:38.064940 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-622835a2-ebc8-441a-87bb-a52cbb831199 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:38.067685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-622835a2-ebc8-441a-87bb-a52cbb831199 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:38.068750 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-622835a2-ebc8-441a-87bb-a52cbb831199 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:38.069215 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-622835a2-ebc8-441a-87bb-a52cbb831199 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:38.105709 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-622835a2-ebc8-441a-87bb-a52cbb831199 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066749 Aug 29 21:57:38.106594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 489/983] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 21:57:38 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:57:38.127419 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-aa7b461b-f7ae-4656-b653-8b64b40a8901 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:38.135572 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-aa7b461b-f7ae-4656-b653-8b64b40a8901 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1242 microversion: 2.1 time: 0.100705 Aug 29 21:57:38.149178 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 495/984] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:38 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:39.044793 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-30c205c4-2bcd-4632-9988-0201dbca8506 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:39.046485 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-30c205c4-2bcd-4632-9988-0201dbca8506 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:39.055601 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-30c205c4-2bcd-4632-9988-0201dbca8506 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:39.056120 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-30c205c4-2bcd-4632-9988-0201dbca8506 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:39.056594 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-30c205c4-2bcd-4632-9988-0201dbca8506 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:39.057946 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-30c205c4-2bcd-4632-9988-0201dbca8506 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:39.058401 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-30c205c4-2bcd-4632-9988-0201dbca8506 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:39.058919 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-30c205c4-2bcd-4632-9988-0201dbca8506 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:39.119486 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d9951f09-8f33-4846-bde4-d11f33fde4af tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:39.121897 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d9951f09-8f33-4846-bde4-d11f33fde4af tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:39.130520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d9951f09-8f33-4846-bde4-d11f33fde4af tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:39.131007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d9951f09-8f33-4846-bde4-d11f33fde4af tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:39.131661 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d9951f09-8f33-4846-bde4-d11f33fde4af tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:39.132960 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d9951f09-8f33-4846-bde4-d11f33fde4af tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:39.132960 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d9951f09-8f33-4846-bde4-d11f33fde4af tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:39.133288 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d9951f09-8f33-4846-bde4-d11f33fde4af tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:39.167440 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d9951f09-8f33-4846-bde4-d11f33fde4af tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052883 Aug 29 21:57:39.168283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 496/985] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 21:57:39 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:57:39.179517 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-3a3fdb3b-beed-4614-bcc3-a2d68f0c6124 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:39.180437 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3a3fdb3b-beed-4614-bcc3-a2d68f0c6124 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:39.190103 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a3fdb3b-beed-4614-bcc3-a2d68f0c6124 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:39.191071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a3fdb3b-beed-4614-bcc3-a2d68f0c6124 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:39.191800 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a3fdb3b-beed-4614-bcc3-a2d68f0c6124 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:39.192779 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a3fdb3b-beed-4614-bcc3-a2d68f0c6124 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:39.193715 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a3fdb3b-beed-4614-bcc3-a2d68f0c6124 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:39.195055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a3fdb3b-beed-4614-bcc3-a2d68f0c6124 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:39.213629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-30c205c4-2bcd-4632-9988-0201dbca8506 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:39.222033 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-30c205c4-2bcd-4632-9988-0201dbca8506 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:39.223463 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-30c205c4-2bcd-4632-9988-0201dbca8506 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:39.225181 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-30c205c4-2bcd-4632-9988-0201dbca8506 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1731 microversion: 2.20 time: 0.184247 Aug 29 21:57:39.225747 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 490/986] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:39 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:39.287863 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-3a3fdb3b-beed-4614-bcc3-a2d68f0c6124 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:39.296835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-3a3fdb3b-beed-4614-bcc3-a2d68f0c6124 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1246 microversion: 2.1 time: 0.127366 Aug 29 21:57:39.297442 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 497/987] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:39 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1246 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:40.181065 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-262a36d3-2a36-45de-ada7-30219cb080ff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:40.184827 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-262a36d3-2a36-45de-ada7-30219cb080ff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:40.192002 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:40.194635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-262a36d3-2a36-45de-ada7-30219cb080ff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:40.195340 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-262a36d3-2a36-45de-ada7-30219cb080ff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:40.195782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-262a36d3-2a36-45de-ada7-30219cb080ff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:40.196740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-262a36d3-2a36-45de-ada7-30219cb080ff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:40.197256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-262a36d3-2a36-45de-ada7-30219cb080ff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:40.197627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-262a36d3-2a36-45de-ada7-30219cb080ff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:40.243075 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-262a36d3-2a36-45de-ada7-30219cb080ff tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066939 Aug 29 21:57:40.248563 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 491/988] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 21:57:40 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:57:40.255484 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9036f548-f04d-496e-bd49-f4f46873e102 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:40.257282 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9036f548-f04d-496e-bd49-f4f46873e102 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:40.267663 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9036f548-f04d-496e-bd49-f4f46873e102 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:40.268228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9036f548-f04d-496e-bd49-f4f46873e102 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:40.268784 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9036f548-f04d-496e-bd49-f4f46873e102 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:40.269518 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9036f548-f04d-496e-bd49-f4f46873e102 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:40.270188 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9036f548-f04d-496e-bd49-f4f46873e102 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:40.270604 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-01e2a3a2-8dda-4472-8692-9641810034e6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:40.270730 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9036f548-f04d-496e-bd49-f4f46873e102 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:40.271759 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-01e2a3a2-8dda-4472-8692-9641810034e6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:40.287609 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-01e2a3a2-8dda-4472-8692-9641810034e6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:40.288508 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-01e2a3a2-8dda-4472-8692-9641810034e6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:40.289457 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-01e2a3a2-8dda-4472-8692-9641810034e6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:40.291254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-01e2a3a2-8dda-4472-8692-9641810034e6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:40.292220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-01e2a3a2-8dda-4472-8692-9641810034e6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:40.293021 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-01e2a3a2-8dda-4472-8692-9641810034e6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:40.416396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-01e2a3a2-8dda-4472-8692-9641810034e6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] HTTP exception thrown: Instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 is not attached to volume bb20a5f9-e4e2-4916-b3c6-cdc94b7dad0a Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-01e2a3a2-8dda-4472-8692-9641810034e6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Request method failure captured: Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: DELETE /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/os-volume_attachments/bb20a5f9-e4e2-4916-b3c6-cdc94b7dad0a HTTP/1.1 Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTWM1tVKN3m6pVkSJzFVPoZ4E9gTtzMTCbQrHr77WWMM-ZqAADW6CYpwE3HcX5s8EXrQ-fb7_j603NtqWaQDzigVIB553XWpK1LZ7VizFbi87Fzq0f3QTnxbYjJiI-6H7TNo-B6c48Q4fFgHcv9sLss-xHYbmnFXwOtkGWYCTXYAfbg Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: cae92c45ec304a2da9a7cafe49bb8b20 Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-TestMinimumBasicScenario-1798066267 Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 21:57:40.423492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 21:57:40.425596 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/cae92c45ec304a2da9a7cafe49bb8b20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_cae92c45ec304a2da9a7cafe49bb8b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/cae92c45ec304a2da9a7cafe49bb8b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/cae92c45ec304a2da9a7cafe49bb8b20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:57:40.425596 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-TestMinimumBasicScenario-1798066267 Aug 29 21:57:40.425596 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: cae92c45ec304a2da9a7cafe49bb8b20 Aug 29 21:57:40.425596 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1798066267 Aug 29 21:57:40.425596 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-TestMinimumBasicScenario-1798066267-project Aug 29 21:57:40.425596 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 21:57:40.425596 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 21:57:40.425596 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 7dcd703ad58a4807b99266f82e8988ca Aug 29 21:57:40.425596 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-TestMinimumBasicScenario-1798066267-project Aug 29 21:57:40.425596 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 21:57:40.425596 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 is not attached to volume bb20a5f9-e4e2-4916-b3c6-cdc94b7dad0a Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'server_id': '8a9b91c1-cfde-4d81-ac00-b83f8b333df9', 'id': 'bb20a5f9-e4e2-4916-b3c6-cdc94b7dad0a'} Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bb20a5f9-e4e2-4916-b3c6-cdc94b7dad0a. Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:57:40.426526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:57:40.428635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:57:40.428635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 21:57:40.428635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 21:57:40.428635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 is not attached to volume bb20a5f9-e4e2-4916-b3c6-cdc94b7dad0a Aug 29 21:57:40.428635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:40.428635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:40.428635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:40.428635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:40.428635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:40.428635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:40.428635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:57:40.428635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:57:40.428635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 is not attached to volume bb20a5f9-e4e2-4916-b3c6-cdc94b7dad0a Aug 29 21:57:40.428635 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:57:40.431076 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-01e2a3a2-8dda-4472-8692-9641810034e6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Returning 404 to user: Instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 is not attached to volume bb20a5f9-e4e2-4916-b3c6-cdc94b7dad0a {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:57:40.432026 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-01e2a3a2-8dda-4472-8692-9641810034e6 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/os-volume_attachments/bb20a5f9-e4e2-4916-b3c6-cdc94b7dad0a" status: 404 len: 154 microversion: 2.1 time: 0.176796 Aug 29 21:57:40.432606 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 492/989] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 21:57:40 2022] DELETE /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9/os-volume_attachments/bb20a5f9-e4e2-4916-b3c6-cdc94b7dad0a => generated 154 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:57:40.445511 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-c5db7818-8ab6-49fe-aeb4-4acced155c14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:40.445807 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-c5db7818-8ab6-49fe-aeb4-4acced155c14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:40.446550 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9036f548-f04d-496e-bd49-f4f46873e102 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:40.452698 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c5db7818-8ab6-49fe-aeb4-4acced155c14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:40.453197 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c5db7818-8ab6-49fe-aeb4-4acced155c14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:40.460743 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c5db7818-8ab6-49fe-aeb4-4acced155c14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:40.460743 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c5db7818-8ab6-49fe-aeb4-4acced155c14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:40.460743 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c5db7818-8ab6-49fe-aeb4-4acced155c14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:40.460743 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c5db7818-8ab6-49fe-aeb4-4acced155c14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:40.461170 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9036f548-f04d-496e-bd49-f4f46873e102 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:40.461170 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9036f548-f04d-496e-bd49-f4f46873e102 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:40.461170 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9036f548-f04d-496e-bd49-f4f46873e102 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1731 microversion: 2.20 time: 0.210248 Aug 29 21:57:40.472383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 498/990] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:40 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:40.521694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-c5db7818-8ab6-49fe-aeb4-4acced155c14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:40.529607 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-c5db7818-8ab6-49fe-aeb4-4acced155c14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1294 microversion: 2.1 time: 0.092519 Aug 29 21:57:40.530187 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 493/991] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:40 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:41.483774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-da108fef-199b-4369-894e-b4cc63b007d5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:41.485094 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-da108fef-199b-4369-894e-b4cc63b007d5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:41.492872 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-da108fef-199b-4369-894e-b4cc63b007d5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:41.493499 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-da108fef-199b-4369-894e-b4cc63b007d5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:41.494207 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-da108fef-199b-4369-894e-b4cc63b007d5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:41.495252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-da108fef-199b-4369-894e-b4cc63b007d5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:41.495959 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-da108fef-199b-4369-894e-b4cc63b007d5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:41.496664 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-da108fef-199b-4369-894e-b4cc63b007d5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:41.552730 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-25892345-9bb3-4a05-866d-d602620c103d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:41.553725 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-25892345-9bb3-4a05-866d-d602620c103d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:41.561814 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-25892345-9bb3-4a05-866d-d602620c103d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:41.562315 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-25892345-9bb3-4a05-866d-d602620c103d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:41.562765 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-25892345-9bb3-4a05-866d-d602620c103d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:41.563581 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-25892345-9bb3-4a05-866d-d602620c103d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:41.564044 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-25892345-9bb3-4a05-866d-d602620c103d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:41.564515 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-25892345-9bb3-4a05-866d-d602620c103d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:41.641891 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-25892345-9bb3-4a05-866d-d602620c103d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:41.646292 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-da108fef-199b-4369-894e-b4cc63b007d5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:41.661101 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-25892345-9bb3-4a05-866d-d602620c103d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1300 microversion: 2.1 time: 0.105056 Aug 29 21:57:41.661101 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 494/992] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:41 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:41.664408 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-da108fef-199b-4369-894e-b4cc63b007d5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:41.666137 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-da108fef-199b-4369-894e-b4cc63b007d5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:41.667342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-da108fef-199b-4369-894e-b4cc63b007d5 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1718 microversion: 2.20 time: 0.188835 Aug 29 21:57:41.668113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 499/993] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:57:41 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1718 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:57:41.741795 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f98ac72b-76b9-4877-ad18-436ee26c4949 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:41.742302 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f98ac72b-76b9-4877-ad18-436ee26c4949 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:41.748879 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f98ac72b-76b9-4877-ad18-436ee26c4949 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:41.749618 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f98ac72b-76b9-4877-ad18-436ee26c4949 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:41.750215 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f98ac72b-76b9-4877-ad18-436ee26c4949 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:41.751135 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f98ac72b-76b9-4877-ad18-436ee26c4949 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:41.751753 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f98ac72b-76b9-4877-ad18-436ee26c4949 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:41.752337 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f98ac72b-76b9-4877-ad18-436ee26c4949 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:41.780886 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f98ac72b-76b9-4877-ad18-436ee26c4949 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Going to try to terminate instance {{(pid=127883) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:57:42.205840 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f98ac72b-76b9-4877-ad18-436ee26c4949 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "DELETE /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 204 len: 0 microversion: 2.1 time: 0.466232 Aug 29 21:57:42.208858 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 495/994] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:57:41 2022] DELETE /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:57:42.234600 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6f599148-6bf4-44b7-a6b7-88257a02ce00 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:42.240861 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-6f599148-6bf4-44b7-a6b7-88257a02ce00 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:42.256134 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6f599148-6bf4-44b7-a6b7-88257a02ce00 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:42.257669 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6f599148-6bf4-44b7-a6b7-88257a02ce00 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:42.258352 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6f599148-6bf4-44b7-a6b7-88257a02ce00 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:42.259919 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6f599148-6bf4-44b7-a6b7-88257a02ce00 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:42.260925 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6f599148-6bf4-44b7-a6b7-88257a02ce00 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:42.261831 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6f599148-6bf4-44b7-a6b7-88257a02ce00 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:42.435009 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-6f599148-6bf4-44b7-a6b7-88257a02ce00 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:42.444610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-6f599148-6bf4-44b7-a6b7-88257a02ce00 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1555 microversion: 2.1 time: 0.230734 Aug 29 21:57:42.445519 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 500/995] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:42 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1555 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:57:42.673361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-92d12d4e-b09b-40e0-ab18-9bf9df457c59 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:42.674092 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-92d12d4e-b09b-40e0-ab18-9bf9df457c59 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:42.681253 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92d12d4e-b09b-40e0-ab18-9bf9df457c59 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:42.681671 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92d12d4e-b09b-40e0-ab18-9bf9df457c59 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:42.682114 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92d12d4e-b09b-40e0-ab18-9bf9df457c59 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:42.682855 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92d12d4e-b09b-40e0-ab18-9bf9df457c59 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:42.683519 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92d12d4e-b09b-40e0-ab18-9bf9df457c59 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:42.683949 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92d12d4e-b09b-40e0-ab18-9bf9df457c59 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:42.821411 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-92d12d4e-b09b-40e0-ab18-9bf9df457c59 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:42.829166 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-92d12d4e-b09b-40e0-ab18-9bf9df457c59 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1367 microversion: 2.1 time: 0.159946 Aug 29 21:57:42.829750 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 496/996] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:42 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:43.466956 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5b90dfa5-1fbc-47a5-bba2-6e202a7b7fcb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:43.467562 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5b90dfa5-1fbc-47a5-bba2-6e202a7b7fcb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:43.474343 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5b90dfa5-1fbc-47a5-bba2-6e202a7b7fcb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:43.474827 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5b90dfa5-1fbc-47a5-bba2-6e202a7b7fcb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:43.475261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5b90dfa5-1fbc-47a5-bba2-6e202a7b7fcb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:43.475954 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5b90dfa5-1fbc-47a5-bba2-6e202a7b7fcb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:43.476402 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5b90dfa5-1fbc-47a5-bba2-6e202a7b7fcb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:43.476858 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5b90dfa5-1fbc-47a5-bba2-6e202a7b7fcb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:43.610681 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5b90dfa5-1fbc-47a5-bba2-6e202a7b7fcb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:43.619542 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5b90dfa5-1fbc-47a5-bba2-6e202a7b7fcb tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1555 microversion: 2.1 time: 0.156478 Aug 29 21:57:43.620133 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 501/997] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:43 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:43.852233 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a3ebed4f-9fe9-4142-9983-4bc31ea6384a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:43.852877 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a3ebed4f-9fe9-4142-9983-4bc31ea6384a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:43.859836 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3ebed4f-9fe9-4142-9983-4bc31ea6384a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:43.860334 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3ebed4f-9fe9-4142-9983-4bc31ea6384a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:43.860813 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3ebed4f-9fe9-4142-9983-4bc31ea6384a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:43.861527 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3ebed4f-9fe9-4142-9983-4bc31ea6384a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:43.861990 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3ebed4f-9fe9-4142-9983-4bc31ea6384a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:43.862418 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a3ebed4f-9fe9-4142-9983-4bc31ea6384a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:44.183735 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-a3ebed4f-9fe9-4142-9983-4bc31ea6384a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:44.193239 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a3ebed4f-9fe9-4142-9983-4bc31ea6384a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1367 microversion: 2.1 time: 0.345357 Aug 29 21:57:44.197577 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 497/998] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:43 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:44.642225 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-8755554a-2d98-4905-b13d-b6de4db9f3f7 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:44.643450 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-8755554a-2d98-4905-b13d-b6de4db9f3f7 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:44.650593 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8755554a-2d98-4905-b13d-b6de4db9f3f7 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:44.651061 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8755554a-2d98-4905-b13d-b6de4db9f3f7 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:44.651894 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8755554a-2d98-4905-b13d-b6de4db9f3f7 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:44.652233 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8755554a-2d98-4905-b13d-b6de4db9f3f7 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:44.652722 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8755554a-2d98-4905-b13d-b6de4db9f3f7 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:44.653145 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-8755554a-2d98-4905-b13d-b6de4db9f3f7 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:44.797333 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-8755554a-2d98-4905-b13d-b6de4db9f3f7 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:44.800578 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:44.807532 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-8755554a-2d98-4905-b13d-b6de4db9f3f7 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1555 microversion: 2.1 time: 0.169974 Aug 29 21:57:44.808294 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 502/999] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:44 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:45.137872 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-c1125005-7298-464d-8fc6-59f4d6b1ceaa req-293ab0cf-4952-4ac8-857f-dad071965117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e3043f-0e5d-4928-9291-6b86323fa54b", "tag": "77872bd0-cbd9-40b8-b1e6-ffb4bb82eead"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:45.159049 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-c1125005-7298-464d-8fc6-59f4d6b1ceaa req-293ab0cf-4952-4ac8-857f-dad071965117 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:45.159049 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-c1125005-7298-464d-8fc6-59f4d6b1ceaa req-293ab0cf-4952-4ac8-857f-dad071965117 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:45.159049 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-c1125005-7298-464d-8fc6-59f4d6b1ceaa req-293ab0cf-4952-4ac8-857f-dad071965117 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:45.167357 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-c1125005-7298-464d-8fc6-59f4d6b1ceaa req-293ab0cf-4952-4ac8-857f-dad071965117 service nova] Creating event network-changed:77872bd0-cbd9-40b8-b1e6-ffb4bb82eead for instance 45e3043f-0e5d-4928-9291-6b86323fa54b on hv-cinder-85426 Aug 29 21:57:45.174379 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-c1125005-7298-464d-8fc6-59f4d6b1ceaa req-293ab0cf-4952-4ac8-857f-dad071965117 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042966 Aug 29 21:57:45.175558 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 498/1000] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:57:45.217553 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-1cbd369a-b5c3-4f8b-91e2-098bb1a49382 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:45.218481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-1cbd369a-b5c3-4f8b-91e2-098bb1a49382 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:45.227236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1cbd369a-b5c3-4f8b-91e2-098bb1a49382 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:45.227726 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1cbd369a-b5c3-4f8b-91e2-098bb1a49382 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:45.228228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1cbd369a-b5c3-4f8b-91e2-098bb1a49382 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:45.228987 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1cbd369a-b5c3-4f8b-91e2-098bb1a49382 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:45.229442 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1cbd369a-b5c3-4f8b-91e2-098bb1a49382 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:45.230035 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-1cbd369a-b5c3-4f8b-91e2-098bb1a49382 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:45.379748 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-1cbd369a-b5c3-4f8b-91e2-098bb1a49382 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:45.387598 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-1cbd369a-b5c3-4f8b-91e2-098bb1a49382 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1367 microversion: 2.1 time: 0.176401 Aug 29 21:57:45.388182 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 503/1001] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:45 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:45.830454 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-9a6e7c15-394c-4869-bc40-1e994c9cc6d0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:45.832532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-9a6e7c15-394c-4869-bc40-1e994c9cc6d0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:45.840020 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9a6e7c15-394c-4869-bc40-1e994c9cc6d0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:45.840559 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9a6e7c15-394c-4869-bc40-1e994c9cc6d0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:45.841185 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9a6e7c15-394c-4869-bc40-1e994c9cc6d0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:45.842127 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9a6e7c15-394c-4869-bc40-1e994c9cc6d0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:45.842842 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9a6e7c15-394c-4869-bc40-1e994c9cc6d0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:45.843297 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9a6e7c15-394c-4869-bc40-1e994c9cc6d0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:45.881973 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9a6e7c15-394c-4869-bc40-1e994c9cc6d0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:45.882415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9a6e7c15-394c-4869-bc40-1e994c9cc6d0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:45.882931 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-9a6e7c15-394c-4869-bc40-1e994c9cc6d0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:45.883357 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-9a6e7c15-394c-4869-bc40-1e994c9cc6d0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lazy-loading 'fault' on Instance uuid 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:57:45.947430 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-9a6e7c15-394c-4869-bc40-1e994c9cc6d0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:45.956246 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-9a6e7c15-394c-4869-bc40-1e994c9cc6d0 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1349 microversion: 2.1 time: 0.130469 Aug 29 21:57:45.960344 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 499/1002] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:45 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1349 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:46.412045 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-7d416973-e98a-457d-a715-22c23e1bc298 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:46.412878 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-7d416973-e98a-457d-a715-22c23e1bc298 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:46.420997 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7d416973-e98a-457d-a715-22c23e1bc298 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:46.421503 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7d416973-e98a-457d-a715-22c23e1bc298 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:46.422360 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7d416973-e98a-457d-a715-22c23e1bc298 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:46.423461 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7d416973-e98a-457d-a715-22c23e1bc298 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:46.424311 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7d416973-e98a-457d-a715-22c23e1bc298 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:46.425513 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7d416973-e98a-457d-a715-22c23e1bc298 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:46.520835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=2 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:46.572494 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-7d416973-e98a-457d-a715-22c23e1bc298 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:46.580354 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-7d416973-e98a-457d-a715-22c23e1bc298 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1367 microversion: 2.1 time: 0.174561 Aug 29 21:57:46.580971 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 504/1003] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:46 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:46.979197 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-81fc269c-986b-4e0e-8034-f50b87d051fe tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:46.979766 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-81fc269c-986b-4e0e-8034-f50b87d051fe tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:46.982228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:46.987324 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-81fc269c-986b-4e0e-8034-f50b87d051fe tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:46.987818 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-81fc269c-986b-4e0e-8034-f50b87d051fe tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:46.988263 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-81fc269c-986b-4e0e-8034-f50b87d051fe tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:46.989012 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-81fc269c-986b-4e0e-8034-f50b87d051fe tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:46.989477 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-81fc269c-986b-4e0e-8034-f50b87d051fe tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:46.989914 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-81fc269c-986b-4e0e-8034-f50b87d051fe tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:47.025268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-81fc269c-986b-4e0e-8034-f50b87d051fe tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:47.025759 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-81fc269c-986b-4e0e-8034-f50b87d051fe tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:47.026203 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-81fc269c-986b-4e0e-8034-f50b87d051fe tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:47.026656 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-81fc269c-986b-4e0e-8034-f50b87d051fe tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lazy-loading 'fault' on Instance uuid 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:57:47.069069 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-81fc269c-986b-4e0e-8034-f50b87d051fe tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcd703ad58a4807b99266f82e8988ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae92c45ec304a2da9a7cafe49bb8b20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:47.077624 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-81fc269c-986b-4e0e-8034-f50b87d051fe tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 200 len: 1349 microversion: 2.1 time: 0.102329 Aug 29 21:57:47.078203 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 500/1004] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:46 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:47.193746 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-6e71c8f4-2cad-4bcb-b20d-1f6e420959e3 req-187e05bd-2b3f-460c-ba26-83d3f22bc647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9b91c1-cfde-4d81-ac00-b83f8b333df9", "name": "network-vif-deleted", "tag": "b88a29b5-ab90-482e-8b10-2c1389ed5c8b"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:47.204152 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-6e71c8f4-2cad-4bcb-b20d-1f6e420959e3 req-187e05bd-2b3f-460c-ba26-83d3f22bc647 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:47.204669 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-6e71c8f4-2cad-4bcb-b20d-1f6e420959e3 req-187e05bd-2b3f-460c-ba26-83d3f22bc647 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:47.205104 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-6e71c8f4-2cad-4bcb-b20d-1f6e420959e3 req-187e05bd-2b3f-460c-ba26-83d3f22bc647 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:47.217534 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-6e71c8f4-2cad-4bcb-b20d-1f6e420959e3 req-187e05bd-2b3f-460c-ba26-83d3f22bc647 service nova] Creating event network-vif-deleted:b88a29b5-ab90-482e-8b10-2c1389ed5c8b for instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 on hv-cinder-85426 Aug 29 21:57:47.229196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-6e71c8f4-2cad-4bcb-b20d-1f6e420959e3 req-187e05bd-2b3f-460c-ba26-83d3f22bc647 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033035 Aug 29 21:57:47.229196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 505/1005] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:57:47.601561 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-73289d09-687c-42b7-9425-8414bb8dd962 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:47.602451 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-73289d09-687c-42b7-9425-8414bb8dd962 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:47.609033 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-73289d09-687c-42b7-9425-8414bb8dd962 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:47.609523 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-73289d09-687c-42b7-9425-8414bb8dd962 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:47.609963 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-73289d09-687c-42b7-9425-8414bb8dd962 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:47.610714 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-73289d09-687c-42b7-9425-8414bb8dd962 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:47.611172 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-73289d09-687c-42b7-9425-8414bb8dd962 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:47.611600 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-73289d09-687c-42b7-9425-8414bb8dd962 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:47.616965 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:47.758913 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-73289d09-687c-42b7-9425-8414bb8dd962 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:47.767050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-73289d09-687c-42b7-9425-8414bb8dd962 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1367 microversion: 2.1 time: 0.169360 Aug 29 21:57:47.767653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 501/1006] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:47 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:48.100475 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0102cd39-8dbd-482a-b42b-dcdfa4e14532 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:48.101200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-0102cd39-8dbd-482a-b42b-dcdfa4e14532 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] [instance: 8a9b91c1-cfde-4d81-ac00-b83f8b333df9] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:48.107477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0102cd39-8dbd-482a-b42b-dcdfa4e14532 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:48.107961 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0102cd39-8dbd-482a-b42b-dcdfa4e14532 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:48.108388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0102cd39-8dbd-482a-b42b-dcdfa4e14532 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:48.109097 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0102cd39-8dbd-482a-b42b-dcdfa4e14532 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:48.109551 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0102cd39-8dbd-482a-b42b-dcdfa4e14532 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:48.123346 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0102cd39-8dbd-482a-b42b-dcdfa4e14532 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:48.123898 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-0102cd39-8dbd-482a-b42b-dcdfa4e14532 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] HTTP exception thrown: Instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 could not be found. Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0102cd39-8dbd-482a-b42b-dcdfa4e14532 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Request method failure captured: Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 HTTP/1.1 Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTWM1tVKN3m6pVkSJzFVPoZ4E9gTtzMTCbQrHr77WWMM-ZqAADW6CYpwE3HcX5s8EXrQ-fb7_j603NtqWaQDzigVIB553XWpK1LZ7VizFbi87Fzq0f3QTnxbYjJiI-6H7TNo-B6c48Q4fFgHcv9sLss-xHYbmnFXwOtkGWYCTXYAfbg Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: cae92c45ec304a2da9a7cafe49bb8b20 Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-TestMinimumBasicScenario-1798066267 Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:57:48.125587 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:57:48.127236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/cae92c45ec304a2da9a7cafe49bb8b20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_cae92c45ec304a2da9a7cafe49bb8b20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/cae92c45ec304a2da9a7cafe49bb8b20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/cae92c45ec304a2da9a7cafe49bb8b20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:57:48.127236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-TestMinimumBasicScenario-1798066267 Aug 29 21:57:48.127236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: cae92c45ec304a2da9a7cafe49bb8b20 Aug 29 21:57:48.127236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1798066267 Aug 29 21:57:48.127236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-TestMinimumBasicScenario-1798066267-project Aug 29 21:57:48.127236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:57:48.127236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:57:48.127236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 7dcd703ad58a4807b99266f82e8988ca Aug 29 21:57:48.127236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-TestMinimumBasicScenario-1798066267-project Aug 29 21:57:48.127236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:57:48.127236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 could not be found. Aug 29 21:57:48.127236 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '8a9b91c1-cfde-4d81-ac00-b83f8b333df9'} Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 could not be found. Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:57:48.128291 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 could not be found. Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 could not be found. Aug 29 21:57:48.129940 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:57:48.131674 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0102cd39-8dbd-482a-b42b-dcdfa4e14532 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Returning 404 to user: Instance 8a9b91c1-cfde-4d81-ac00-b83f8b333df9 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:57:48.131674 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-0102cd39-8dbd-482a-b42b-dcdfa4e14532 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9" status: 404 len: 111 microversion: 2.1 time: 0.031773 Aug 29 21:57:48.131674 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 506/1007] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:48 2022] GET /compute/v2.1/servers/8a9b91c1-cfde-4d81-ac00-b83f8b333df9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:57:48.136100 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8e2a83c5-3973-42f7-b77a-60ad17c810a3 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] Calling method '.version_select at 0x7f50404f1160>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:48.229961 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-8e2a83c5-3973-42f7-b77a-60ad17c810a3 tempest-TestMinimumBasicScenario-1798066267 tempest-TestMinimumBasicScenario-1798066267-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1342581860" status: 202 len: 0 microversion: 2.1 time: 0.097857 Aug 29 21:57:48.243685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 502/1008] 10.222.0.83 () {58 vars in 1272 bytes} [Mon Aug 29 21:57:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1342581860 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:57:48.788856 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d414bf1a-a16d-40e8-98ac-18ccf1d0ae72 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:48.789393 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d414bf1a-a16d-40e8-98ac-18ccf1d0ae72 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:48.791376 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=12 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:48.796542 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d414bf1a-a16d-40e8-98ac-18ccf1d0ae72 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:48.801507 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d414bf1a-a16d-40e8-98ac-18ccf1d0ae72 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:48.801507 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d414bf1a-a16d-40e8-98ac-18ccf1d0ae72 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:48.801507 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d414bf1a-a16d-40e8-98ac-18ccf1d0ae72 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:48.801507 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d414bf1a-a16d-40e8-98ac-18ccf1d0ae72 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:48.801969 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d414bf1a-a16d-40e8-98ac-18ccf1d0ae72 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:48.952319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d414bf1a-a16d-40e8-98ac-18ccf1d0ae72 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:48.961155 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d414bf1a-a16d-40e8-98ac-18ccf1d0ae72 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1367 microversion: 2.1 time: 0.176311 Aug 29 21:57:48.961728 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 507/1009] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:48 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:57:49.982457 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4b4504fc-10a6-45ef-9fd7-d2982ab84894 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:49.983167 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4b4504fc-10a6-45ef-9fd7-d2982ab84894 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:49.990019 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4b4504fc-10a6-45ef-9fd7-d2982ab84894 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:49.990509 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4b4504fc-10a6-45ef-9fd7-d2982ab84894 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:49.990955 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4b4504fc-10a6-45ef-9fd7-d2982ab84894 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:49.991659 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4b4504fc-10a6-45ef-9fd7-d2982ab84894 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:49.992113 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4b4504fc-10a6-45ef-9fd7-d2982ab84894 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:49.992584 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4b4504fc-10a6-45ef-9fd7-d2982ab84894 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:50.145257 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4b4504fc-10a6-45ef-9fd7-d2982ab84894 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:50.154013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4b4504fc-10a6-45ef-9fd7-d2982ab84894 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1367 microversion: 2.1 time: 0.175808 Aug 29 21:57:50.154597 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 503/1010] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:49 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:50.537336 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-f13977ad-3835-4643-afe2-f7e54bc0940f req-62c8676a-bbb7-41ee-a816-83e445abca28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e3043f-0e5d-4928-9291-6b86323fa54b", "name": "network-vif-plugged", "status": "completed", "tag": "77872bd0-cbd9-40b8-b1e6-ffb4bb82eead"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:50.558764 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-f13977ad-3835-4643-afe2-f7e54bc0940f req-62c8676a-bbb7-41ee-a816-83e445abca28 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:50.559273 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-f13977ad-3835-4643-afe2-f7e54bc0940f req-62c8676a-bbb7-41ee-a816-83e445abca28 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:50.559710 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-f13977ad-3835-4643-afe2-f7e54bc0940f req-62c8676a-bbb7-41ee-a816-83e445abca28 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:50.572213 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-f13977ad-3835-4643-afe2-f7e54bc0940f req-62c8676a-bbb7-41ee-a816-83e445abca28 service nova] Creating event network-vif-plugged:77872bd0-cbd9-40b8-b1e6-ffb4bb82eead for instance 45e3043f-0e5d-4928-9291-6b86323fa54b on hv-cinder-85426 Aug 29 21:57:50.577338 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-f13977ad-3835-4643-afe2-f7e54bc0940f req-62c8676a-bbb7-41ee-a816-83e445abca28 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051322 Aug 29 21:57:50.577994 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 508/1011] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:57:51.181318 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ec1014e7-b6c6-49fc-ab85-a6781179ad8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:51.182644 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ec1014e7-b6c6-49fc-ab85-a6781179ad8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:51.192384 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ec1014e7-b6c6-49fc-ab85-a6781179ad8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:51.192384 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ec1014e7-b6c6-49fc-ab85-a6781179ad8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:51.192881 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ec1014e7-b6c6-49fc-ab85-a6781179ad8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:51.193651 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ec1014e7-b6c6-49fc-ab85-a6781179ad8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:51.194104 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ec1014e7-b6c6-49fc-ab85-a6781179ad8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:51.194535 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ec1014e7-b6c6-49fc-ab85-a6781179ad8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:51.378577 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ec1014e7-b6c6-49fc-ab85-a6781179ad8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:51.396727 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ec1014e7-b6c6-49fc-ab85-a6781179ad8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1367 microversion: 2.1 time: 0.224623 Aug 29 21:57:51.397335 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 504/1012] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:51 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:52.419796 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9652b202-5484-46fa-9415-665d3ab8af14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:52.421258 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9652b202-5484-46fa-9415-665d3ab8af14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:52.429411 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9652b202-5484-46fa-9415-665d3ab8af14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:52.435770 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9652b202-5484-46fa-9415-665d3ab8af14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:52.435770 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9652b202-5484-46fa-9415-665d3ab8af14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:52.435770 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9652b202-5484-46fa-9415-665d3ab8af14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:52.435770 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9652b202-5484-46fa-9415-665d3ab8af14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:52.436203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9652b202-5484-46fa-9415-665d3ab8af14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:52.587471 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9652b202-5484-46fa-9415-665d3ab8af14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:52.596121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9652b202-5484-46fa-9415-665d3ab8af14 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1367 microversion: 2.1 time: 0.180841 Aug 29 21:57:52.598055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 509/1013] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:52 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:57:53.634152 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-da578c37-954e-4562-ba83-ce83fa45776b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:53.634935 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-da578c37-954e-4562-ba83-ce83fa45776b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:53.650956 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-da578c37-954e-4562-ba83-ce83fa45776b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:53.651478 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-da578c37-954e-4562-ba83-ce83fa45776b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:53.651945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-da578c37-954e-4562-ba83-ce83fa45776b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:53.652694 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-da578c37-954e-4562-ba83-ce83fa45776b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:53.653218 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-da578c37-954e-4562-ba83-ce83fa45776b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:53.654418 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-da578c37-954e-4562-ba83-ce83fa45776b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:53.831626 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-da578c37-954e-4562-ba83-ce83fa45776b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:57:53.848216 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-da578c37-954e-4562-ba83-ce83fa45776b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1557 microversion: 2.1 time: 0.218862 Aug 29 21:57:53.848216 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 505/1014] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:57:53 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:57:53.870448 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-2808d581-d4c3-4a44-9bca-646541831448 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:57:53.871033 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-2808d581-d4c3-4a44-9bca-646541831448 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:57:53.878302 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2808d581-d4c3-4a44-9bca-646541831448 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:53.878799 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2808d581-d4c3-4a44-9bca-646541831448 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:53.879328 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2808d581-d4c3-4a44-9bca-646541831448 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:53.883313 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2808d581-d4c3-4a44-9bca-646541831448 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:53.883313 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2808d581-d4c3-4a44-9bca-646541831448 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:53.883313 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-2808d581-d4c3-4a44-9bca-646541831448 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:53.998859 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-2808d581-d4c3-4a44-9bca-646541831448 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132978 Aug 29 21:57:54.009114 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 510/1015] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 21:57:53 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b/os-interface => generated 284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:57:55.431959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-bac82066-191b-447f-a6f3-8f0e8f2157e5 req-e0a5fd76-82ba-478c-86c5-60a1541f83ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e3043f-0e5d-4928-9291-6b86323fa54b", "tag": "77872bd0-cbd9-40b8-b1e6-ffb4bb82eead"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:57:55.443279 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-bac82066-191b-447f-a6f3-8f0e8f2157e5 req-e0a5fd76-82ba-478c-86c5-60a1541f83ee service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:57:55.443766 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-bac82066-191b-447f-a6f3-8f0e8f2157e5 req-e0a5fd76-82ba-478c-86c5-60a1541f83ee service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:57:55.444474 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-bac82066-191b-447f-a6f3-8f0e8f2157e5 req-e0a5fd76-82ba-478c-86c5-60a1541f83ee service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:57:55.461318 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-bac82066-191b-447f-a6f3-8f0e8f2157e5 req-e0a5fd76-82ba-478c-86c5-60a1541f83ee service nova] Creating event network-changed:77872bd0-cbd9-40b8-b1e6-ffb4bb82eead for instance 45e3043f-0e5d-4928-9291-6b86323fa54b on hv-cinder-85426 Aug 29 21:57:55.467528 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-bac82066-191b-447f-a6f3-8f0e8f2157e5 req-e0a5fd76-82ba-478c-86c5-60a1541f83ee service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039326 Aug 29 21:57:55.468387 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 506/1016] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:58:15.361123 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=35 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:15.362017 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=34 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:15.367344 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a7ff264a-a511-48c5-afea-625ed2e8cfda tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:15.369613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a7ff264a-a511-48c5-afea-625ed2e8cfda tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:15.381888 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a7ff264a-a511-48c5-afea-625ed2e8cfda tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:15.381888 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a7ff264a-a511-48c5-afea-625ed2e8cfda tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:15.381888 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a7ff264a-a511-48c5-afea-625ed2e8cfda tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:15.381888 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a7ff264a-a511-48c5-afea-625ed2e8cfda tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:15.382369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a7ff264a-a511-48c5-afea-625ed2e8cfda tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:15.382369 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a7ff264a-a511-48c5-afea-625ed2e8cfda tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:15.410447 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a7ff264a-a511-48c5-afea-625ed2e8cfda tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051152 Aug 29 21:58:15.411026 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 511/1017] 10.222.0.83 () {60 vars in 1343 bytes} [Mon Aug 29 21:58:15 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:15.478683 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:15.479515 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=24 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:15.484050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-c8f70472-d3be-46e5-8b0b-bb6bda30fc94 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:15.484720 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-c8f70472-d3be-46e5-8b0b-bb6bda30fc94 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:15.491943 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c8f70472-d3be-46e5-8b0b-bb6bda30fc94 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:15.492434 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c8f70472-d3be-46e5-8b0b-bb6bda30fc94 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:15.497830 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c8f70472-d3be-46e5-8b0b-bb6bda30fc94 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:15.497830 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c8f70472-d3be-46e5-8b0b-bb6bda30fc94 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:15.497830 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c8f70472-d3be-46e5-8b0b-bb6bda30fc94 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:15.497830 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c8f70472-d3be-46e5-8b0b-bb6bda30fc94 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:15.521700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-c8f70472-d3be-46e5-8b0b-bb6bda30fc94 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Going to try to terminate instance {{(pid=127883) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:58:15.823118 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-c8f70472-d3be-46e5-8b0b-bb6bda30fc94 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 204 len: 0 microversion: 2.20 time: 0.346187 Aug 29 21:58:15.823716 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 507/1018] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 21:58:15 2022] DELETE /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 21:58:15.832746 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-dc374280-a5ef-453b-893d-c799a7692955 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:15.833510 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-dc374280-a5ef-453b-893d-c799a7692955 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:15.844163 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dc374280-a5ef-453b-893d-c799a7692955 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:15.844883 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dc374280-a5ef-453b-893d-c799a7692955 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:15.845381 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dc374280-a5ef-453b-893d-c799a7692955 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:15.846187 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dc374280-a5ef-453b-893d-c799a7692955 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:15.846823 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dc374280-a5ef-453b-893d-c799a7692955 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:15.847611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dc374280-a5ef-453b-893d-c799a7692955 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:16.004994 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-dc374280-a5ef-453b-893d-c799a7692955 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:16.018135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-dc374280-a5ef-453b-893d-c799a7692955 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:16.018135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-dc374280-a5ef-453b-893d-c799a7692955 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:16.018135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-dc374280-a5ef-453b-893d-c799a7692955 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.189625 Aug 29 21:58:16.018798 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 512/1019] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:58:15 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:58:17.043876 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4322a368-fd0a-43ed-8f16-4bbcc340370b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:17.044598 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4322a368-fd0a-43ed-8f16-4bbcc340370b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:17.051274 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4322a368-fd0a-43ed-8f16-4bbcc340370b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:17.051790 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4322a368-fd0a-43ed-8f16-4bbcc340370b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:17.052184 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4322a368-fd0a-43ed-8f16-4bbcc340370b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:17.053006 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4322a368-fd0a-43ed-8f16-4bbcc340370b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:17.053364 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4322a368-fd0a-43ed-8f16-4bbcc340370b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:17.053789 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4322a368-fd0a-43ed-8f16-4bbcc340370b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:17.189138 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4322a368-fd0a-43ed-8f16-4bbcc340370b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:17.197878 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4322a368-fd0a-43ed-8f16-4bbcc340370b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:17.199306 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-4322a368-fd0a-43ed-8f16-4bbcc340370b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:17.200509 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4322a368-fd0a-43ed-8f16-4bbcc340370b tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1724 microversion: 2.20 time: 0.160897 Aug 29 21:58:17.201095 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 508/1020] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:58:17 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:58:18.224654 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-40dd4385-acb7-4e1b-8258-1e4fe2db0e90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:18.225361 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-40dd4385-acb7-4e1b-8258-1e4fe2db0e90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:18.234148 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-40dd4385-acb7-4e1b-8258-1e4fe2db0e90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:18.234662 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-40dd4385-acb7-4e1b-8258-1e4fe2db0e90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:18.235799 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-40dd4385-acb7-4e1b-8258-1e4fe2db0e90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:18.237108 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-40dd4385-acb7-4e1b-8258-1e4fe2db0e90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:18.248170 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-40dd4385-acb7-4e1b-8258-1e4fe2db0e90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:18.248170 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-40dd4385-acb7-4e1b-8258-1e4fe2db0e90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:18.312021 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-40dd4385-acb7-4e1b-8258-1e4fe2db0e90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:18.320985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-40dd4385-acb7-4e1b-8258-1e4fe2db0e90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:18.322457 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-40dd4385-acb7-4e1b-8258-1e4fe2db0e90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb465b4782514e7d8e75a7dc14c0a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754af1c2cd154e91ad9ecbee3ce04d0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:18.326058 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-40dd4385-acb7-4e1b-8258-1e4fe2db0e90 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 200 len: 1656 microversion: 2.20 time: 0.104102 Aug 29 21:58:18.326058 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 513/1021] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:58:18 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 1656 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 21:58:18.472296 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-f9f0897f-8bf5-448f-950f-b4065249fb43 req-ca770beb-c729-49ad-8041-8f34d5279aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01db998-129a-4b44-a3c4-1da1bf023620", "name": "network-vif-deleted", "tag": "95ba8615-923a-46f1-ae70-f15459156d2b"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:58:18.483428 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-f9f0897f-8bf5-448f-950f-b4065249fb43 req-ca770beb-c729-49ad-8041-8f34d5279aeb service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:18.483904 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-f9f0897f-8bf5-448f-950f-b4065249fb43 req-ca770beb-c729-49ad-8041-8f34d5279aeb service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:18.484334 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-f9f0897f-8bf5-448f-950f-b4065249fb43 req-ca770beb-c729-49ad-8041-8f34d5279aeb service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:18.497841 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-f9f0897f-8bf5-448f-950f-b4065249fb43 req-ca770beb-c729-49ad-8041-8f34d5279aeb service nova] Creating event network-vif-deleted:95ba8615-923a-46f1-ae70-f15459156d2b for instance d01db998-129a-4b44-a3c4-1da1bf023620 on hv-cinder-85426 Aug 29 21:58:18.502826 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-f9f0897f-8bf5-448f-950f-b4065249fb43 req-ca770beb-c729-49ad-8041-8f34d5279aeb service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034117 Aug 29 21:58:18.503479 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 509/1022] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:58:19.353136 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a81b0b72-7556-4173-b15f-fb04845d900f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:19.353136 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a81b0b72-7556-4173-b15f-fb04845d900f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:19.354503 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a81b0b72-7556-4173-b15f-fb04845d900f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:19.355058 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a81b0b72-7556-4173-b15f-fb04845d900f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:19.356202 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a81b0b72-7556-4173-b15f-fb04845d900f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:19.357304 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a81b0b72-7556-4173-b15f-fb04845d900f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:19.357901 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a81b0b72-7556-4173-b15f-fb04845d900f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:19.358338 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a81b0b72-7556-4173-b15f-fb04845d900f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:19.373879 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-a81b0b72-7556-4173-b15f-fb04845d900f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] HTTP exception thrown: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a81b0b72-7556-4173-b15f-fb04845d900f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Request method failure captured: Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 HTTP/1.1 Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTSszBLoeCq5sEX64Blc8btbeM2FEgGCul8XtuGultVF6_zKbAfkcA1RD5X_RNPicnb2BQXKgwqOSiR04TnNg7So-l_WPObZs6JUi3Ju3WwNhJaJ2Hw9FpaKlPP4JRSWhX28-2kKHRhffWhKl3PZFR20ZH-V_QE0-kKfAbdBBWVk7EU Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 754af1c2cd154e91ad9ecbee3ce04d0d Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:58:19.375922 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:58:19.377769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:58:19.377769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:58:19.377769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 754af1c2cd154e91ad9ecbee3ce04d0d Aug 29 21:58:19.377769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:58:19.377769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeShelveTestJSON-1569171829-project Aug 29 21:58:19.377769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:58:19.377769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:58:19.377769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: fb465b4782514e7d8e75a7dc14c0a1e7 Aug 29 21:58:19.377769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1569171829-project Aug 29 21:58:19.377769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:58:19.377769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. Aug 29 21:58:19.377769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': 'd01db998-129a-4b44-a3c4-1da1bf023620'} Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:58:19.378743 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. Aug 29 21:58:19.381071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:58:19.382526 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a81b0b72-7556-4173-b15f-fb04845d900f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Returning 404 to user: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:58:19.383287 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a81b0b72-7556-4173-b15f-fb04845d900f tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 404 len: 111 microversion: 2.20 time: 0.040899 Aug 29 21:58:19.385643 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 514/1023] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:58:19 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:58:19.393821 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-c8be7601-eab9-480f-99f3-31be142c9dba tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '.version_select at 0x7f504055e160>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:19.504689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-c8be7601-eab9-480f-99f3-31be142c9dba tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1560396454" status: 204 len: 0 microversion: 2.20 time: 0.115082 Aug 29 21:58:19.506159 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 510/1024] 10.222.0.83 () {60 vars in 1262 bytes} [Mon Aug 29 21:58:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1560396454 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 21:58:21.725704 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-497e9759-ab81-40e8-975f-288810a840e4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:21.729039 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-497e9759-ab81-40e8-975f-288810a840e4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:21.733063 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-497e9759-ab81-40e8-975f-288810a840e4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:21.733555 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-497e9759-ab81-40e8-975f-288810a840e4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:21.734314 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-497e9759-ab81-40e8-975f-288810a840e4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:21.735063 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-497e9759-ab81-40e8-975f-288810a840e4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:21.735527 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-497e9759-ab81-40e8-975f-288810a840e4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:21.735955 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-497e9759-ab81-40e8-975f-288810a840e4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:21.751357 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-497e9759-ab81-40e8-975f-288810a840e4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] HTTP exception thrown: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-497e9759-ab81-40e8-975f-288810a840e4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Request method failure captured: Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: DELETE /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 HTTP/1.1 Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTSszBLoeCq5sEX64Blc8btbeM2FEgGCul8XtuGultVF6_zKbAfkcA1RD5X_RNPicnb2BQXKgwqOSiR04TnNg7So-l_WPObZs6JUi3Ju3WwNhJaJ2Hw9FpaKlPP4JRSWhX28-2kKHRhffWhKl3PZFR20ZH-V_QE0-kKfAbdBBWVk7EU Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 754af1c2cd154e91ad9ecbee3ce04d0d Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:58:21.752991 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:58:21.754789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:58:21.754789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:58:21.754789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 754af1c2cd154e91ad9ecbee3ce04d0d Aug 29 21:58:21.754789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:58:21.754789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeShelveTestJSON-1569171829-project Aug 29 21:58:21.754789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:58:21.754789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:58:21.754789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: fb465b4782514e7d8e75a7dc14c0a1e7 Aug 29 21:58:21.754789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1569171829-project Aug 29 21:58:21.754789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:58:21.754789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. Aug 29 21:58:21.754789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': 'd01db998-129a-4b44-a3c4-1da1bf023620'} Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:58:21.759434 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. Aug 29 21:58:21.760891 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:58:21.762185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-497e9759-ab81-40e8-975f-288810a840e4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Returning 404 to user: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:58:21.762185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-497e9759-ab81-40e8-975f-288810a840e4 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "DELETE /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 404 len: 111 microversion: 2.20 time: 0.032569 Aug 29 21:58:21.762185 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 515/1025] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 21:58:21 2022] DELETE /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:58:21.765605 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-37121379-4613-4370-9c74-b72ea1345b11 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:21.766473 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-37121379-4613-4370-9c74-b72ea1345b11 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: d01db998-129a-4b44-a3c4-1da1bf023620] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:21.777290 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-37121379-4613-4370-9c74-b72ea1345b11 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:21.777783 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-37121379-4613-4370-9c74-b72ea1345b11 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:21.778228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-37121379-4613-4370-9c74-b72ea1345b11 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:21.778940 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-37121379-4613-4370-9c74-b72ea1345b11 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:21.779396 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-37121379-4613-4370-9c74-b72ea1345b11 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:21.779830 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-37121379-4613-4370-9c74-b72ea1345b11 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:21.793911 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-37121379-4613-4370-9c74-b72ea1345b11 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] HTTP exception thrown: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-37121379-4613-4370-9c74-b72ea1345b11 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Request method failure captured: Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 HTTP/1.1 Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTSszBLoeCq5sEX64Blc8btbeM2FEgGCul8XtuGultVF6_zKbAfkcA1RD5X_RNPicnb2BQXKgwqOSiR04TnNg7So-l_WPObZs6JUi3Ju3WwNhJaJ2Hw9FpaKlPP4JRSWhX28-2kKHRhffWhKl3PZFR20ZH-V_QE0-kKfAbdBBWVk7EU Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: 754af1c2cd154e91ad9ecbee3ce04d0d Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 21:58:21.797916 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 21:58:21.800887 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:58:21.800887 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:58:21.800887 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: 754af1c2cd154e91ad9ecbee3ce04d0d Aug 29 21:58:21.800887 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:58:21.800887 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-AttachVolumeShelveTestJSON-1569171829-project Aug 29 21:58:21.800887 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 21:58:21.800887 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 21:58:21.800887 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: fb465b4782514e7d8e75a7dc14c0a1e7 Aug 29 21:58:21.800887 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1569171829-project Aug 29 21:58:21.800887 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 21:58:21.800887 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. Aug 29 21:58:21.800887 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': 'd01db998-129a-4b44-a3c4-1da1bf023620'} Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:58:21.802899 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. Aug 29 21:58:21.806140 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:58:21.808417 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-37121379-4613-4370-9c74-b72ea1345b11 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Returning 404 to user: Instance d01db998-129a-4b44-a3c4-1da1bf023620 could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:58:21.808417 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-37121379-4613-4370-9c74-b72ea1345b11 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620" status: 404 len: 111 microversion: 2.20 time: 0.036959 Aug 29 21:58:21.808417 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 511/1026] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:58:21 2022] GET /compute/v2.1/servers/d01db998-129a-4b44-a3c4-1da1bf023620 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:58:23.105652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-31684da9-7c46-44f7-8168-0010b7aacd46 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:23.106285 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-31684da9-7c46-44f7-8168-0010b7aacd46 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:23.112677 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-31684da9-7c46-44f7-8168-0010b7aacd46 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:23.113305 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-31684da9-7c46-44f7-8168-0010b7aacd46 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:23.113637 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-31684da9-7c46-44f7-8168-0010b7aacd46 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:23.114983 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-31684da9-7c46-44f7-8168-0010b7aacd46 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:23.115482 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-31684da9-7c46-44f7-8168-0010b7aacd46 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:23.115894 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-31684da9-7c46-44f7-8168-0010b7aacd46 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:23.130548 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-31684da9-7c46-44f7-8168-0010b7aacd46 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] HTTP exception thrown: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-31684da9-7c46-44f7-8168-0010b7aacd46 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Request method failure captured: Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: DELETE /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f HTTP/1.1 Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTSszBLoeCq5sEX64Blc8btbeM2FEgGCul8XtuGultVF6_zKbAfkcA1RD5X_RNPicnb2BQXKgwqOSiR04TnNg7So-l_WPObZs6JUi3Ju3WwNhJaJ2Hw9FpaKlPP4JRSWhX28-2kKHRhffWhKl3PZFR20ZH-V_QE0-kKfAbdBBWVk7EU Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 754af1c2cd154e91ad9ecbee3ce04d0d Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:58:23.132126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:58:23.133771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:58:23.133771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:58:23.133771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 754af1c2cd154e91ad9ecbee3ce04d0d Aug 29 21:58:23.133771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:58:23.133771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeShelveTestJSON-1569171829-project Aug 29 21:58:23.133771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:58:23.133771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:58:23.133771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: fb465b4782514e7d8e75a7dc14c0a1e7 Aug 29 21:58:23.133771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1569171829-project Aug 29 21:58:23.133771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:58:23.133771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. Aug 29 21:58:23.133771 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '9e60ebcd-98c1-4442-9c72-f4d9760c8d6f'} Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:58:23.134617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. Aug 29 21:58:23.135958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:58:23.137346 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-31684da9-7c46-44f7-8168-0010b7aacd46 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Returning 404 to user: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:58:23.137346 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-31684da9-7c46-44f7-8168-0010b7aacd46 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "DELETE /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 404 len: 111 microversion: 2.20 time: 0.031850 Aug 29 21:58:23.137346 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 516/1027] 10.222.0.83 () {60 vars in 1280 bytes} [Mon Aug 29 21:58:23 2022] DELETE /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:58:23.142944 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b311ad78-6acc-424d-84b5-80af365fff24 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:23.143664 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-b311ad78-6acc-424d-84b5-80af365fff24 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] [instance: 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:23.150158 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b311ad78-6acc-424d-84b5-80af365fff24 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:23.150642 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b311ad78-6acc-424d-84b5-80af365fff24 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:23.151075 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b311ad78-6acc-424d-84b5-80af365fff24 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:23.151783 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b311ad78-6acc-424d-84b5-80af365fff24 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:23.152233 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b311ad78-6acc-424d-84b5-80af365fff24 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:23.152751 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-b311ad78-6acc-424d-84b5-80af365fff24 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:23.167021 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-b311ad78-6acc-424d-84b5-80af365fff24 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] HTTP exception thrown: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b311ad78-6acc-424d-84b5-80af365fff24 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Request method failure captured: Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f HTTP/1.1 Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTSszBLoeCq5sEX64Blc8btbeM2FEgGCul8XtuGultVF6_zKbAfkcA1RD5X_RNPicnb2BQXKgwqOSiR04TnNg7So-l_WPObZs6JUi3Ju3WwNhJaJ2Hw9FpaKlPP4JRSWhX28-2kKHRhffWhKl3PZFR20ZH-V_QE0-kKfAbdBBWVk7EU Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: 754af1c2cd154e91ad9ecbee3ce04d0d Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 21:58:23.168602 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 21:58:23.170149 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/754af1c2cd154e91ad9ecbee3ce04d0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:58:23.170149 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:58:23.170149 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: 754af1c2cd154e91ad9ecbee3ce04d0d Aug 29 21:58:23.170149 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1569171829 Aug 29 21:58:23.170149 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-AttachVolumeShelveTestJSON-1569171829-project Aug 29 21:58:23.170149 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 21:58:23.170149 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 21:58:23.170149 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: fb465b4782514e7d8e75a7dc14c0a1e7 Aug 29 21:58:23.170149 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1569171829-project Aug 29 21:58:23.170149 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 21:58:23.170149 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. Aug 29 21:58:23.170149 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': '9e60ebcd-98c1-4442-9c72-f4d9760c8d6f'} Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:58:23.170945 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. Aug 29 21:58:23.172210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:58:23.173462 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-b311ad78-6acc-424d-84b5-80af365fff24 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] Returning 404 to user: Instance 9e60ebcd-98c1-4442-9c72-f4d9760c8d6f could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:58:23.173462 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-b311ad78-6acc-424d-84b5-80af365fff24 tempest-AttachVolumeShelveTestJSON-1569171829 tempest-AttachVolumeShelveTestJSON-1569171829-project] 10.222.0.83 "GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f" status: 404 len: 111 microversion: 2.20 time: 0.031051 Aug 29 21:58:23.173462 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 512/1028] 10.222.0.83 () {60 vars in 1277 bytes} [Mon Aug 29 21:58:23 2022] GET /compute/v2.1/servers/9e60ebcd-98c1-4442-9c72-f4d9760c8d6f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:58:30.974993 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c535809c-bc68-454a-b54d-c6c75a91d0dd tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:30.975560 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c535809c-bc68-454a-b54d-c6c75a91d0dd tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:30.983795 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-1ef7a4b1-040f-46e4-9844-16f36fdd73ce req-870ddb09-d81d-4f1c-8d22-c2c4943fdf06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b90c4eb2-99e9-4c0f-9336-0ecd87390a9f", "tag": "245c7474-204e-46f8-a4ef-735e7fa0f46e"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:58:30.991994 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c535809c-bc68-454a-b54d-c6c75a91d0dd tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:30.992526 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c535809c-bc68-454a-b54d-c6c75a91d0dd tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:30.992942 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c535809c-bc68-454a-b54d-c6c75a91d0dd tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:30.993643 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c535809c-bc68-454a-b54d-c6c75a91d0dd tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:30.994094 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c535809c-bc68-454a-b54d-c6c75a91d0dd tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:30.994515 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c535809c-bc68-454a-b54d-c6c75a91d0dd tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:31.016214 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-1ef7a4b1-040f-46e4-9844-16f36fdd73ce req-870ddb09-d81d-4f1c-8d22-c2c4943fdf06 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:31.018823 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-1ef7a4b1-040f-46e4-9844-16f36fdd73ce req-870ddb09-d81d-4f1c-8d22-c2c4943fdf06 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:31.019672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-1ef7a4b1-040f-46e4-9844-16f36fdd73ce req-870ddb09-d81d-4f1c-8d22-c2c4943fdf06 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:31.033435 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-1ef7a4b1-040f-46e4-9844-16f36fdd73ce req-870ddb09-d81d-4f1c-8d22-c2c4943fdf06 service nova] Creating event network-changed:245c7474-204e-46f8-a4ef-735e7fa0f46e for instance b90c4eb2-99e9-4c0f-9336-0ecd87390a9f on hv-cinder-85426 Aug 29 21:58:31.039218 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c535809c-bc68-454a-b54d-c6c75a91d0dd tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Going to try to terminate instance {{(pid=127882) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:58:31.040115 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-1ef7a4b1-040f-46e4-9844-16f36fdd73ce req-870ddb09-d81d-4f1c-8d22-c2c4943fdf06 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059718 Aug 29 21:58:31.041335 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 513/1029] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:58:31.521853 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c535809c-bc68-454a-b54d-c6c75a91d0dd tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 204 len: 0 microversion: 2.1 time: 0.549971 Aug 29 21:58:31.522519 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 517/1030] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:58:30 2022] DELETE /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:58:31.540195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-411fc22a-fc29-4ef4-970d-b631c9cbef26 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:31.541025 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-411fc22a-fc29-4ef4-970d-b631c9cbef26 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:31.547932 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-411fc22a-fc29-4ef4-970d-b631c9cbef26 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:31.548668 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-411fc22a-fc29-4ef4-970d-b631c9cbef26 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:31.549371 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-411fc22a-fc29-4ef4-970d-b631c9cbef26 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:31.550146 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-411fc22a-fc29-4ef4-970d-b631c9cbef26 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:31.551015 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-411fc22a-fc29-4ef4-970d-b631c9cbef26 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:31.551685 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-411fc22a-fc29-4ef4-970d-b631c9cbef26 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:31.695556 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f109a8a6-b705-442a-a2ea-80944836daac tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:31.696204 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f109a8a6-b705-442a-a2ea-80944836daac tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:31.711526 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f109a8a6-b705-442a-a2ea-80944836daac tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:31.711526 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f109a8a6-b705-442a-a2ea-80944836daac tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:31.712900 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f109a8a6-b705-442a-a2ea-80944836daac tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:31.715290 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f109a8a6-b705-442a-a2ea-80944836daac tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:31.716437 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f109a8a6-b705-442a-a2ea-80944836daac tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:31.718172 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f109a8a6-b705-442a-a2ea-80944836daac tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:31.793395 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f109a8a6-b705-442a-a2ea-80944836daac tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b/ips" status: 200 len: 150 microversion: 2.1 time: 0.108881 Aug 29 21:58:31.795018 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 518/1031] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 21:58:31 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b/ips => generated 150 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:58:32.085037 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-411fc22a-fc29-4ef4-970d-b631c9cbef26 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:32.094019 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-411fc22a-fc29-4ef4-970d-b631c9cbef26 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1571 microversion: 2.1 time: 0.558251 Aug 29 21:58:32.094648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 514/1032] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:31 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1571 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:33.115769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a21aa6d2-38d4-48fb-ab46-8916f3dc4390 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:33.116402 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a21aa6d2-38d4-48fb-ab46-8916f3dc4390 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:33.123085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a21aa6d2-38d4-48fb-ab46-8916f3dc4390 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:33.125180 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a21aa6d2-38d4-48fb-ab46-8916f3dc4390 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:33.125180 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a21aa6d2-38d4-48fb-ab46-8916f3dc4390 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:33.125180 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a21aa6d2-38d4-48fb-ab46-8916f3dc4390 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:33.125484 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a21aa6d2-38d4-48fb-ab46-8916f3dc4390 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:33.125711 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a21aa6d2-38d4-48fb-ab46-8916f3dc4390 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:33.280608 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a21aa6d2-38d4-48fb-ab46-8916f3dc4390 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:33.287811 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a21aa6d2-38d4-48fb-ab46-8916f3dc4390 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1452 microversion: 2.1 time: 0.176417 Aug 29 21:58:33.288501 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 519/1033] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:33 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:33.603962 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-1ad414b4-951b-45c0-90e2-9789ec433f8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c4b604d-5ddc-4b36-ba0f-195af89d6400"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:58:33.606786 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-1ad414b4-951b-45c0-90e2-9789ec433f8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:33.615035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1ad414b4-951b-45c0-90e2-9789ec433f8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:33.616121 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1ad414b4-951b-45c0-90e2-9789ec433f8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:33.617013 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1ad414b4-951b-45c0-90e2-9789ec433f8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:33.618392 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1ad414b4-951b-45c0-90e2-9789ec433f8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:33.619256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1ad414b4-951b-45c0-90e2-9789ec433f8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:33.619947 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1ad414b4-951b-45c0-90e2-9789ec433f8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:34.035134 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-4f762a34-b340-4b18-9426-db69f92d4e30 req-b54fbfe1-cbd7-44d0-95f3-1360c4324537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90c4eb2-99e9-4c0f-9336-0ecd87390a9f", "name": "network-vif-deleted", "tag": "245c7474-204e-46f8-a4ef-735e7fa0f46e"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:58:34.045466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-4f762a34-b340-4b18-9426-db69f92d4e30 req-b54fbfe1-cbd7-44d0-95f3-1360c4324537 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:34.045999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-4f762a34-b340-4b18-9426-db69f92d4e30 req-b54fbfe1-cbd7-44d0-95f3-1360c4324537 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:34.046383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-4f762a34-b340-4b18-9426-db69f92d4e30 req-b54fbfe1-cbd7-44d0-95f3-1360c4324537 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:34.061325 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-4f762a34-b340-4b18-9426-db69f92d4e30 req-b54fbfe1-cbd7-44d0-95f3-1360c4324537 service nova] Creating event network-vif-deleted:245c7474-204e-46f8-a4ef-735e7fa0f46e for instance b90c4eb2-99e9-4c0f-9336-0ecd87390a9f on hv-cinder-85426 Aug 29 21:58:34.067767 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-4f762a34-b340-4b18-9426-db69f92d4e30 req-b54fbfe1-cbd7-44d0-95f3-1360c4324537 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036379 Aug 29 21:58:34.068550 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 520/1034] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:58:34.311464 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-3a5db421-4c00-4573-9b00-b7d89ef262e1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:34.312747 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3a5db421-4c00-4573-9b00-b7d89ef262e1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:34.321013 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a5db421-4c00-4573-9b00-b7d89ef262e1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:34.321509 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a5db421-4c00-4573-9b00-b7d89ef262e1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:34.321963 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a5db421-4c00-4573-9b00-b7d89ef262e1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:34.322954 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a5db421-4c00-4573-9b00-b7d89ef262e1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:34.323440 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a5db421-4c00-4573-9b00-b7d89ef262e1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:34.327492 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a5db421-4c00-4573-9b00-b7d89ef262e1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:34.408782 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-3a5db421-4c00-4573-9b00-b7d89ef262e1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:34.421053 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-3a5db421-4c00-4573-9b00-b7d89ef262e1 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1220 microversion: 2.1 time: 0.114780 Aug 29 21:58:34.421714 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 521/1035] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:34 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:58:34.751867 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-1ad414b4-951b-45c0-90e2-9789ec433f8f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "POST /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.151503 Aug 29 21:58:34.753236 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 515/1036] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 21:58:33 2022] POST /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b/os-volume_attachments => generated 194 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 21:58:35.442753 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ecea1a9e-51d7-4e29-9504-9323a68cb251 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:35.443350 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ecea1a9e-51d7-4e29-9504-9323a68cb251 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:35.450078 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ecea1a9e-51d7-4e29-9504-9323a68cb251 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:35.450565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ecea1a9e-51d7-4e29-9504-9323a68cb251 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:35.451007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ecea1a9e-51d7-4e29-9504-9323a68cb251 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:35.451701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ecea1a9e-51d7-4e29-9504-9323a68cb251 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:35.452158 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ecea1a9e-51d7-4e29-9504-9323a68cb251 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:35.452623 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ecea1a9e-51d7-4e29-9504-9323a68cb251 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:35.484884 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ecea1a9e-51d7-4e29-9504-9323a68cb251 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:35.485367 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ecea1a9e-51d7-4e29-9504-9323a68cb251 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:35.485799 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ecea1a9e-51d7-4e29-9504-9323a68cb251 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:35.486239 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-ecea1a9e-51d7-4e29-9504-9323a68cb251 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lazy-loading 'fault' on Instance uuid b90c4eb2-99e9-4c0f-9336-0ecd87390a9f {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:58:35.532744 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ecea1a9e-51d7-4e29-9504-9323a68cb251 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '297a016ff2944b33a06d5ce81735fb8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b08d1c1dcf64187b53e4e3a76b6e346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:35.541641 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ecea1a9e-51d7-4e29-9504-9323a68cb251 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 200 len: 1225 microversion: 2.1 time: 0.102884 Aug 29 21:58:35.542222 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 522/1037] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:35 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:36.564960 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f282ccd3-02d7-4112-b049-5ffbe3088ba6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:36.565654 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f282ccd3-02d7-4112-b049-5ffbe3088ba6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] [instance: b90c4eb2-99e9-4c0f-9336-0ecd87390a9f] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:36.572136 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f282ccd3-02d7-4112-b049-5ffbe3088ba6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:36.572669 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f282ccd3-02d7-4112-b049-5ffbe3088ba6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:36.573106 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f282ccd3-02d7-4112-b049-5ffbe3088ba6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:36.573809 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f282ccd3-02d7-4112-b049-5ffbe3088ba6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:36.574289 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f282ccd3-02d7-4112-b049-5ffbe3088ba6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:36.574678 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f282ccd3-02d7-4112-b049-5ffbe3088ba6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:36.593088 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-f282ccd3-02d7-4112-b049-5ffbe3088ba6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] HTTP exception thrown: Instance b90c4eb2-99e9-4c0f-9336-0ecd87390a9f could not be found. Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f282ccd3-02d7-4112-b049-5ffbe3088ba6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Request method failure captured: Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f HTTP/1.1 Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTUYgjdLG9CpsGDpbnDzizBW8j4rdSThu2yN16bzoFL-S9GvqPvRUAn8XIihmksvAULiykJTLhWrrhbUoXGO-xSql6zHYAf9c2-Gid-R1UkIjogQzDodyB4PBVLRmADBCYhgLZtTf39DXDGOB0aYEN88B1Wgy4NpeSG74y5bdyU0TA4 Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: 2b08d1c1dcf64187b53e4e3a76b6e346 Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-TestShelveInstance-1529051070 Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 21:58:36.594746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 21:58:36.601368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2b08d1c1dcf64187b53e4e3a76b6e346"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_2b08d1c1dcf64187b53e4e3a76b6e346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/2b08d1c1dcf64187b53e4e3a76b6e346"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/2b08d1c1dcf64187b53e4e3a76b6e346"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:58:36.601368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-TestShelveInstance-1529051070 Aug 29 21:58:36.601368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: 2b08d1c1dcf64187b53e4e3a76b6e346 Aug 29 21:58:36.601368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-TestShelveInstance-1529051070 Aug 29 21:58:36.601368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-TestShelveInstance-1529051070-project Aug 29 21:58:36.601368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 21:58:36.601368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 21:58:36.601368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 297a016ff2944b33a06d5ce81735fb8d Aug 29 21:58:36.601368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-TestShelveInstance-1529051070-project Aug 29 21:58:36.601368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 21:58:36.601368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance b90c4eb2-99e9-4c0f-9336-0ecd87390a9f could not be found. Aug 29 21:58:36.601368 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': 'b90c4eb2-99e9-4c0f-9336-0ecd87390a9f'} Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90c4eb2-99e9-4c0f-9336-0ecd87390a9f could not be found. Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:58:36.602761 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90c4eb2-99e9-4c0f-9336-0ecd87390a9f could not be found. Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90c4eb2-99e9-4c0f-9336-0ecd87390a9f could not be found. Aug 29 21:58:36.604291 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:58:36.605775 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f282ccd3-02d7-4112-b049-5ffbe3088ba6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Returning 404 to user: Instance b90c4eb2-99e9-4c0f-9336-0ecd87390a9f could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:58:36.605775 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f282ccd3-02d7-4112-b049-5ffbe3088ba6 tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f" status: 404 len: 111 microversion: 2.1 time: 0.035953 Aug 29 21:58:36.605775 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 516/1038] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:36 2022] GET /compute/v2.1/servers/b90c4eb2-99e9-4c0f-9336-0ecd87390a9f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:58:36.840580 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-499d0945-fed2-4b74-8a6c-bf66b7c835da tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] Calling method '.version_select at 0x7f50405e3820>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:36.940415 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-499d0945-fed2-4b74-8a6c-bf66b7c835da tempest-TestShelveInstance-1529051070 tempest-TestShelveInstance-1529051070-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1130395365" status: 202 len: 0 microversion: 2.1 time: 0.102070 Aug 29 21:58:36.940415 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 523/1039] 10.222.0.83 () {58 vars in 1254 bytes} [Mon Aug 29 21:58:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1130395365 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:58:37.097445 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f90b8cd7-42d7-4341-bfe3-6c686a49c864 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Action: 'create', calling method: .version_select at 0x7f50406fcf70>, body: {"keypair": {"name": "tempest-keypair-537047581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqvwx0Pivkyr9kfmUhi9kdMgAWJXtpa4JZI47okhZZAJZV23hui9q+QpP99Ai528Nxe6kp5tCvjsTd9II3eOno8GthjaxzJ0qhFQeganOxLvmvBEoPQnOHvkKWJlltTUw=="}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:58:37.129185 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-f90b8cd7-42d7-4341-bfe3-6c686a49c864 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for project 926837c28a3743deab8a4849571ecd19. Resources: {'key_pairs'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:58:37.141416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-f90b8cd7-42d7-4341-bfe3-6c686a49c864 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for user 3a878450743f4843a5e8cc04ca94184d and project 926837c28a3743deab8a4849571ecd19. Resources: {'key_pairs'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:58:37.242393 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f90b8cd7-42d7-4341-bfe3-6c686a49c864 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.148839 Aug 29 21:58:37.248677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 517/1040] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 21:58:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:58:39.885988 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-814524240", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffd5a48c-ee26-4008-a0d2-7fefac315aca"}], "security_groups": [{"name": "tempest-securitygroup--900874356"}], "key_name": "tempest-keypair-537047581", "user_data": "}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:58:39.999099 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.network.neutron [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] validate_networks() for [('ffd5a48c-ee26-4008-a0d2-7fefac315aca', None, None, None, None, None)] {{(pid=127882) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:58:40.762048 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Flavor limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:58:40.762593 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Image limits 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:58:40.762942 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Flavor pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:58:40.763619 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Image pref 0:0:0 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:58:40.764162 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.virt.hardware [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127882) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:58:40.783685 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:40.784183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:40.784774 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:40.786057 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:40.786518 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:40.786955 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:40.815975 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for project 926837c28a3743deab8a4849571ecd19. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:58:40.821893 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for user 3a878450743f4843a5e8cc04ca94184d and project 926837c28a3743deab8a4849571ecd19. Resources: {'ram', 'cores', 'instances'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:58:40.837429 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Going to run 1 instances... {{(pid=127882) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:58:40.839831 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127882) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:58:41.016024 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-741a43be-cb85-46a5-ba94-b36bd09e4140 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.143274 Aug 29 21:58:41.017113 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 524/1041] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:58:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 21:58:41.029591 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-1f76c848-2f2f-4054-b874-961b7c928dbf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:41.030715 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-1f76c848-2f2f-4054-b874-961b7c928dbf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:41.175606 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-1f76c848-2f2f-4054-b874-961b7c928dbf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:41.191336 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-1f76c848-2f2f-4054-b874-961b7c928dbf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1240 microversion: 2.1 time: 0.166638 Aug 29 21:58:41.214909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 518/1042] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:41 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1240 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:42.220552 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5fc895fc-8d2c-47d9-b3a5-783ecdee01c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:42.221570 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5fc895fc-8d2c-47d9-b3a5-783ecdee01c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:42.244183 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5fc895fc-8d2c-47d9-b3a5-783ecdee01c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:42.250389 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5fc895fc-8d2c-47d9-b3a5-783ecdee01c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:42.250389 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5fc895fc-8d2c-47d9-b3a5-783ecdee01c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:42.250389 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5fc895fc-8d2c-47d9-b3a5-783ecdee01c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:42.250389 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5fc895fc-8d2c-47d9-b3a5-783ecdee01c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:42.250835 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5fc895fc-8d2c-47d9-b3a5-783ecdee01c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:42.369249 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-5fc895fc-8d2c-47d9-b3a5-783ecdee01c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:42.377397 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5fc895fc-8d2c-47d9-b3a5-783ecdee01c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1244 microversion: 2.1 time: 0.162791 Aug 29 21:58:42.378358 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 525/1043] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:42 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1244 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:43.399921 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-926c407e-1eac-4e09-bf9b-a05f092ce63c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:43.405423 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-926c407e-1eac-4e09-bf9b-a05f092ce63c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:43.409173 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-926c407e-1eac-4e09-bf9b-a05f092ce63c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:43.410237 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-926c407e-1eac-4e09-bf9b-a05f092ce63c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:43.411254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-926c407e-1eac-4e09-bf9b-a05f092ce63c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:43.412259 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-926c407e-1eac-4e09-bf9b-a05f092ce63c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:43.413229 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-926c407e-1eac-4e09-bf9b-a05f092ce63c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:43.414480 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-926c407e-1eac-4e09-bf9b-a05f092ce63c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:43.584319 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-926c407e-1eac-4e09-bf9b-a05f092ce63c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:43.622708 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-926c407e-1eac-4e09-bf9b-a05f092ce63c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1292 microversion: 2.1 time: 0.226753 Aug 29 21:58:43.623300 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 519/1044] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:43 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1292 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:44.647765 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d340d8a6-53cc-4885-8964-86549830f62a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:44.648572 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d340d8a6-53cc-4885-8964-86549830f62a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:44.658025 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d340d8a6-53cc-4885-8964-86549830f62a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:44.658667 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d340d8a6-53cc-4885-8964-86549830f62a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:44.659390 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d340d8a6-53cc-4885-8964-86549830f62a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:44.660382 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d340d8a6-53cc-4885-8964-86549830f62a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:44.661216 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d340d8a6-53cc-4885-8964-86549830f62a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:44.661958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d340d8a6-53cc-4885-8964-86549830f62a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:44.799098 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-d340d8a6-53cc-4885-8964-86549830f62a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:44.814296 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d340d8a6-53cc-4885-8964-86549830f62a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1298 microversion: 2.1 time: 0.173811 Aug 29 21:58:44.815912 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 526/1045] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:44 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1298 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:45.846281 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-584f02e0-9699-484a-b2ab-4ddd114e4919 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:45.846971 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-584f02e0-9699-484a-b2ab-4ddd114e4919 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:45.851240 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:45.871547 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-584f02e0-9699-484a-b2ab-4ddd114e4919 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:45.877025 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-584f02e0-9699-484a-b2ab-4ddd114e4919 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:45.879545 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-584f02e0-9699-484a-b2ab-4ddd114e4919 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:45.880438 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-584f02e0-9699-484a-b2ab-4ddd114e4919 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:45.883857 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-584f02e0-9699-484a-b2ab-4ddd114e4919 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:45.885507 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-584f02e0-9699-484a-b2ab-4ddd114e4919 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:45.893062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:46.177371 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-584f02e0-9699-484a-b2ab-4ddd114e4919 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:46.185011 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-584f02e0-9699-484a-b2ab-4ddd114e4919 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1365 microversion: 2.1 time: 0.343251 Aug 29 21:58:46.185623 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 520/1046] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:45 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:46.742171 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-85eb0c0b-c2a5-4fdf-acb1-08dd1d9b4b52 req-081ef6a5-fd1e-428c-b28e-631881d6741f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9af2023-7f55-4a86-b266-b2c6e8ec7878", "tag": "5e1bed99-3c35-45a7-85e6-5d7f697b0eb3"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:58:46.750435 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:46.757552 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-85eb0c0b-c2a5-4fdf-acb1-08dd1d9b4b52 req-081ef6a5-fd1e-428c-b28e-631881d6741f service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:46.758414 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-85eb0c0b-c2a5-4fdf-acb1-08dd1d9b4b52 req-081ef6a5-fd1e-428c-b28e-631881d6741f service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:46.759029 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-85eb0c0b-c2a5-4fdf-acb1-08dd1d9b4b52 req-081ef6a5-fd1e-428c-b28e-631881d6741f service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:46.762276 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:46.774222 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-85eb0c0b-c2a5-4fdf-acb1-08dd1d9b4b52 req-081ef6a5-fd1e-428c-b28e-631881d6741f service nova] Creating event network-changed:5e1bed99-3c35-45a7-85e6-5d7f697b0eb3 for instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 on hv-cinder-85426 Aug 29 21:58:46.780114 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-85eb0c0b-c2a5-4fdf-acb1-08dd1d9b4b52 req-081ef6a5-fd1e-428c-b28e-631881d6741f service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043023 Aug 29 21:58:46.781695 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 527/1047] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:58:47.209741 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-911b63b4-0b6c-4a1c-a802-cd83ab4b0c1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:47.210669 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-911b63b4-0b6c-4a1c-a802-cd83ab4b0c1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:47.219268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-911b63b4-0b6c-4a1c-a802-cd83ab4b0c1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:47.219820 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-911b63b4-0b6c-4a1c-a802-cd83ab4b0c1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:47.220731 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-911b63b4-0b6c-4a1c-a802-cd83ab4b0c1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:47.221460 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-911b63b4-0b6c-4a1c-a802-cd83ab4b0c1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:47.221929 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-911b63b4-0b6c-4a1c-a802-cd83ab4b0c1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:47.222358 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-911b63b4-0b6c-4a1c-a802-cd83ab4b0c1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:47.465671 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-911b63b4-0b6c-4a1c-a802-cd83ab4b0c1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:47.476172 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-911b63b4-0b6c-4a1c-a802-cd83ab4b0c1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1365 microversion: 2.1 time: 0.271583 Aug 29 21:58:47.476472 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 521/1048] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:47 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:48.499759 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-867c1e23-1782-4029-8caa-4a773b8fab34 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:48.500459 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-867c1e23-1782-4029-8caa-4a773b8fab34 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:48.508757 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-867c1e23-1782-4029-8caa-4a773b8fab34 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:48.509277 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-867c1e23-1782-4029-8caa-4a773b8fab34 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:48.509715 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-867c1e23-1782-4029-8caa-4a773b8fab34 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:48.510421 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-867c1e23-1782-4029-8caa-4a773b8fab34 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:48.510875 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-867c1e23-1782-4029-8caa-4a773b8fab34 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:48.511283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-867c1e23-1782-4029-8caa-4a773b8fab34 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:48.661454 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-867c1e23-1782-4029-8caa-4a773b8fab34 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:48.669145 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-867c1e23-1782-4029-8caa-4a773b8fab34 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1365 microversion: 2.1 time: 0.174668 Aug 29 21:58:48.669763 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 528/1049] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:48 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:49.691665 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e21ff9c4-cd25-46de-89d0-bdb91bb0de1e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:49.692824 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e21ff9c4-cd25-46de-89d0-bdb91bb0de1e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:49.700000 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e21ff9c4-cd25-46de-89d0-bdb91bb0de1e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:49.700500 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e21ff9c4-cd25-46de-89d0-bdb91bb0de1e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:49.700961 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e21ff9c4-cd25-46de-89d0-bdb91bb0de1e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:49.701717 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e21ff9c4-cd25-46de-89d0-bdb91bb0de1e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:49.702173 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e21ff9c4-cd25-46de-89d0-bdb91bb0de1e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:49.702596 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e21ff9c4-cd25-46de-89d0-bdb91bb0de1e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:49.841591 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e21ff9c4-cd25-46de-89d0-bdb91bb0de1e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:49.852654 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e21ff9c4-cd25-46de-89d0-bdb91bb0de1e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1365 microversion: 2.1 time: 0.165660 Aug 29 21:58:49.853248 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 522/1050] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:49 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:50.879479 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-db592834-b099-443b-bf76-406da055b589 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:50.880809 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-db592834-b099-443b-bf76-406da055b589 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:50.888300 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=2 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:50.889589 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=6 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:50.898778 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db592834-b099-443b-bf76-406da055b589 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:50.899816 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db592834-b099-443b-bf76-406da055b589 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:50.900597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db592834-b099-443b-bf76-406da055b589 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:50.904613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db592834-b099-443b-bf76-406da055b589 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:50.904613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db592834-b099-443b-bf76-406da055b589 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:50.904613 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db592834-b099-443b-bf76-406da055b589 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:51.091596 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-db592834-b099-443b-bf76-406da055b589 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:51.103496 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-db592834-b099-443b-bf76-406da055b589 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1365 microversion: 2.1 time: 0.232300 Aug 29 21:58:51.104515 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 529/1051] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:50 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:52.127569 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-87b7bd74-67d9-47f0-8d66-c3dc0713a421 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:52.128310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-87b7bd74-67d9-47f0-8d66-c3dc0713a421 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:52.130891 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=6 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:52.136401 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87b7bd74-67d9-47f0-8d66-c3dc0713a421 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:52.137314 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87b7bd74-67d9-47f0-8d66-c3dc0713a421 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:52.137806 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87b7bd74-67d9-47f0-8d66-c3dc0713a421 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:52.138552 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87b7bd74-67d9-47f0-8d66-c3dc0713a421 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:52.139017 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87b7bd74-67d9-47f0-8d66-c3dc0713a421 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:52.139479 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-87b7bd74-67d9-47f0-8d66-c3dc0713a421 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:52.299204 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-87b7bd74-67d9-47f0-8d66-c3dc0713a421 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:52.307484 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-87b7bd74-67d9-47f0-8d66-c3dc0713a421 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1365 microversion: 2.1 time: 0.184225 Aug 29 21:58:52.308063 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 523/1052] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:52 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:52.851138 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-92a7a417-ec82-499b-aaa6-efa3ead75aa0 req-a5d1fe21-5551-4ada-a0e9-503f1cba5db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9af2023-7f55-4a86-b266-b2c6e8ec7878", "name": "network-vif-plugged", "status": "completed", "tag": "5e1bed99-3c35-45a7-85e6-5d7f697b0eb3"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:58:52.863050 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-92a7a417-ec82-499b-aaa6-efa3ead75aa0 req-a5d1fe21-5551-4ada-a0e9-503f1cba5db9 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:52.867860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-92a7a417-ec82-499b-aaa6-efa3ead75aa0 req-a5d1fe21-5551-4ada-a0e9-503f1cba5db9 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:52.867860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-92a7a417-ec82-499b-aaa6-efa3ead75aa0 req-a5d1fe21-5551-4ada-a0e9-503f1cba5db9 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:52.876560 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-92a7a417-ec82-499b-aaa6-efa3ead75aa0 req-a5d1fe21-5551-4ada-a0e9-503f1cba5db9 service nova] Creating event network-vif-plugged:5e1bed99-3c35-45a7-85e6-5d7f697b0eb3 for instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 on hv-cinder-85426 Aug 29 21:58:52.882470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-92a7a417-ec82-499b-aaa6-efa3ead75aa0 req-a5d1fe21-5551-4ada-a0e9-503f1cba5db9 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035513 Aug 29 21:58:52.883164 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 530/1053] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:58:53.328492 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-bc36dfa9-e31b-48b6-a61d-ca9a03d49905 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:53.329242 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-bc36dfa9-e31b-48b6-a61d-ca9a03d49905 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:53.335874 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bc36dfa9-e31b-48b6-a61d-ca9a03d49905 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:53.336442 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bc36dfa9-e31b-48b6-a61d-ca9a03d49905 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:53.336912 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bc36dfa9-e31b-48b6-a61d-ca9a03d49905 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:53.337616 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bc36dfa9-e31b-48b6-a61d-ca9a03d49905 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:53.338136 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bc36dfa9-e31b-48b6-a61d-ca9a03d49905 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:53.338535 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bc36dfa9-e31b-48b6-a61d-ca9a03d49905 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:53.473190 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-bc36dfa9-e31b-48b6-a61d-ca9a03d49905 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:53.481720 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-bc36dfa9-e31b-48b6-a61d-ca9a03d49905 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1365 microversion: 2.1 time: 0.157092 Aug 29 21:58:53.482309 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 524/1054] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:53 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:54.504718 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f5f63f65-012f-4115-8ed3-4ebc488ad01f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:54.506171 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f5f63f65-012f-4115-8ed3-4ebc488ad01f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:54.513515 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f5f63f65-012f-4115-8ed3-4ebc488ad01f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:54.514014 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f5f63f65-012f-4115-8ed3-4ebc488ad01f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:54.514465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f5f63f65-012f-4115-8ed3-4ebc488ad01f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:54.515197 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f5f63f65-012f-4115-8ed3-4ebc488ad01f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:54.515659 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f5f63f65-012f-4115-8ed3-4ebc488ad01f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:54.516086 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f5f63f65-012f-4115-8ed3-4ebc488ad01f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:54.671200 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-f5f63f65-012f-4115-8ed3-4ebc488ad01f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:58:54.686018 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f5f63f65-012f-4115-8ed3-4ebc488ad01f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1556 microversion: 2.1 time: 0.185900 Aug 29 21:58:54.687100 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 531/1055] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:58:54 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1556 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:58:54.710838 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e20428b6-a1bc-4135-8647-f20df9d2ac88 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:58:54.712086 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e20428b6-a1bc-4135-8647-f20df9d2ac88 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:58:54.720521 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e20428b6-a1bc-4135-8647-f20df9d2ac88 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:54.720521 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e20428b6-a1bc-4135-8647-f20df9d2ac88 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:54.720521 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e20428b6-a1bc-4135-8647-f20df9d2ac88 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:54.720521 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e20428b6-a1bc-4135-8647-f20df9d2ac88 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:54.721254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e20428b6-a1bc-4135-8647-f20df9d2ac88 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:54.721883 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e20428b6-a1bc-4135-8647-f20df9d2ac88 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:54.804901 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e20428b6-a1bc-4135-8647-f20df9d2ac88 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099176 Aug 29 21:58:54.808205 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 525/1056] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 21:58:54 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:58:56.135760 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-c3c80ffa-22b3-4f6d-ac88-4d6de0408903 req-2b180264-9e6d-48d8-8899-d6319e27e966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9af2023-7f55-4a86-b266-b2c6e8ec7878", "tag": "5e1bed99-3c35-45a7-85e6-5d7f697b0eb3"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:58:56.149018 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-c3c80ffa-22b3-4f6d-ac88-4d6de0408903 req-2b180264-9e6d-48d8-8899-d6319e27e966 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:58:56.149757 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-c3c80ffa-22b3-4f6d-ac88-4d6de0408903 req-2b180264-9e6d-48d8-8899-d6319e27e966 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:58:56.151529 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-c3c80ffa-22b3-4f6d-ac88-4d6de0408903 req-2b180264-9e6d-48d8-8899-d6319e27e966 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:58:56.169973 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-c3c80ffa-22b3-4f6d-ac88-4d6de0408903 req-2b180264-9e6d-48d8-8899-d6319e27e966 service nova] Creating event network-changed:5e1bed99-3c35-45a7-85e6-5d7f697b0eb3 for instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 on hv-cinder-85426 Aug 29 21:58:56.175252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-c3c80ffa-22b3-4f6d-ac88-4d6de0408903 req-2b180264-9e6d-48d8-8899-d6319e27e966 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043002 Aug 29 21:58:56.175928 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 532/1057] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:59:32.125889 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=11 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:32.126728 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=33 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:32.128095 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 29 21:59:32.134915 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-4335400a-dfa5-4582-87cc-3a35645fc65d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:32.138927 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-4335400a-dfa5-4582-87cc-3a35645fc65d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:32.141493 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4335400a-dfa5-4582-87cc-3a35645fc65d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:32.141984 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4335400a-dfa5-4582-87cc-3a35645fc65d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:32.142428 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4335400a-dfa5-4582-87cc-3a35645fc65d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:32.143126 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4335400a-dfa5-4582-87cc-3a35645fc65d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:32.143584 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4335400a-dfa5-4582-87cc-3a35645fc65d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:32.144014 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-4335400a-dfa5-4582-87cc-3a35645fc65d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:32.171655 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-4335400a-dfa5-4582-87cc-3a35645fc65d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878/ips" status: 200 len: 149 microversion: 2.1 time: 0.047307 Aug 29 21:59:32.172323 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 526/1058] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 21:59:32 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:59:32.182575 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=11 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:32.185541 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=23 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:32.188375 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5c93d88c-c6f9-497b-a151-5090f72228b0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c4b604d-5ddc-4b36-ba0f-195af89d6400"}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:59:32.191085 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5c93d88c-c6f9-497b-a151-5090f72228b0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:32.199479 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5c93d88c-c6f9-497b-a151-5090f72228b0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:32.200023 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5c93d88c-c6f9-497b-a151-5090f72228b0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:32.200464 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5c93d88c-c6f9-497b-a151-5090f72228b0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:32.201243 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5c93d88c-c6f9-497b-a151-5090f72228b0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:32.201703 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5c93d88c-c6f9-497b-a151-5090f72228b0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:32.202133 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5c93d88c-c6f9-497b-a151-5090f72228b0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:32.289296 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-5c93d88c-c6f9-497b-a151-5090f72228b0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] HTTP exception thrown: Invalid volume: volume 0c4b604d-5ddc-4b36-ba0f-195af89d6400 is already attached to instances: 45e3043f-0e5d-4928-9291-6b86323fa54b Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5c93d88c-c6f9-497b-a151-5090f72228b0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Request method failure captured: Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: POST /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878/os-volume_attachments HTTP/1.1 Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 74 Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTZLVEObYhy0XvUUBWReeF5_kugi_bGrw2NNDFt07_UsV3pUzA3h3sIgkCsJDb8h6RjVLqb8H4JpVV6TDe-f8caIDdu7ab4GDnUrNqI-5GJXbQUYIEbL-eXnbUDWZ_kWZwPzrCKTL6HNsAkc49EWegEnggwEm8jJ-obMU_4_tuUcdeo Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:59:32.291319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:59:32.293141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_926837c28a3743deab8a4849571ecd19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/926837c28a3743deab8a4849571ecd19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:59:32.293141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeNegativeTest-671996841 Aug 29 21:59:32.293141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 21:59:32.293141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 21:59:32.293141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 21:59:32.293141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:59:32.293141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:59:32.293141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 3a878450743f4843a5e8cc04ca94184d Aug 29 21:59:32.293141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 21:59:32.293141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Aug 29 21:59:32.293141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {"volumeAttachment": {"volumeId": "0c4b604d-5ddc-4b36-ba0f-195af89d6400"}} Aug 29 21:59:32.293141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Invalid volume: volume 0c4b604d-5ddc-4b36-ba0f-195af89d6400 is already attached to instances: 45e3043f-0e5d-4928-9291-6b86323fa54b Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'server_id': 'b9af2023-7f55-4a86-b266-b2c6e8ec7878', 'body': {'volumeAttachment': {'volumeId': '0c4b604d-5ddc-4b36-ba0f-195af89d6400'}}} Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0c4b604d-5ddc-4b36-ba0f-195af89d6400 is already attached to instances: 45e3043f-0e5d-4928-9291-6b86323fa54b Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:59:32.294115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0c4b604d-5ddc-4b36-ba0f-195af89d6400 is already attached to instances: 45e3043f-0e5d-4928-9291-6b86323fa54b Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:59:32.295540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:59:32.296970 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:59:32.296970 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:59:32.296970 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:59:32.296970 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0c4b604d-5ddc-4b36-ba0f-195af89d6400 is already attached to instances: 45e3043f-0e5d-4928-9291-6b86323fa54b Aug 29 21:59:32.296970 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:59:32.296970 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5c93d88c-c6f9-497b-a151-5090f72228b0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Returning 400 to user: Invalid volume: volume 0c4b604d-5ddc-4b36-ba0f-195af89d6400 is already attached to instances: 45e3043f-0e5d-4928-9291-6b86323fa54b {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:59:32.296970 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5c93d88c-c6f9-497b-a151-5090f72228b0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "POST /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112080 Aug 29 21:59:32.296970 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 533/1059] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 21:59:32 2022] POST /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 21:59:32.302627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f9ab25da-4df4-4bd6-8999-0a4b20dac4ab tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:32.303130 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f9ab25da-4df4-4bd6-8999-0a4b20dac4ab tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:32.310391 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9ab25da-4df4-4bd6-8999-0a4b20dac4ab tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:32.310968 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9ab25da-4df4-4bd6-8999-0a4b20dac4ab tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:32.311321 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9ab25da-4df4-4bd6-8999-0a4b20dac4ab tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:32.312039 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9ab25da-4df4-4bd6-8999-0a4b20dac4ab tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:32.312515 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9ab25da-4df4-4bd6-8999-0a4b20dac4ab tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:32.312944 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f9ab25da-4df4-4bd6-8999-0a4b20dac4ab tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:32.346904 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f9ab25da-4df4-4bd6-8999-0a4b20dac4ab tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Going to try to terminate instance {{(pid=127883) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:59:32.840204 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f9ab25da-4df4-4bd6-8999-0a4b20dac4ab tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 204 len: 0 microversion: 2.1 time: 0.541955 Aug 29 21:59:32.840759 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 527/1060] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:59:32 2022] DELETE /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:59:32.850578 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-19782244-3683-4b08-82f5-05bd3fe0dccf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:32.851191 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-19782244-3683-4b08-82f5-05bd3fe0dccf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:32.857499 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-19782244-3683-4b08-82f5-05bd3fe0dccf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:32.857989 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-19782244-3683-4b08-82f5-05bd3fe0dccf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:32.858427 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-19782244-3683-4b08-82f5-05bd3fe0dccf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:32.859139 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-19782244-3683-4b08-82f5-05bd3fe0dccf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:32.859594 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-19782244-3683-4b08-82f5-05bd3fe0dccf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:32.860028 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-19782244-3683-4b08-82f5-05bd3fe0dccf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:33.003030 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-19782244-3683-4b08-82f5-05bd3fe0dccf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:33.013933 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-19782244-3683-4b08-82f5-05bd3fe0dccf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1679 microversion: 2.1 time: 0.168135 Aug 29 21:59:33.015209 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 534/1061] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:32 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:59:34.049229 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e82c9762-bad2-4ff8-ac79-2a8a1386ddc1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:34.049954 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e82c9762-bad2-4ff8-ac79-2a8a1386ddc1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:34.057469 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e82c9762-bad2-4ff8-ac79-2a8a1386ddc1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:34.063173 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e82c9762-bad2-4ff8-ac79-2a8a1386ddc1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:34.063173 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e82c9762-bad2-4ff8-ac79-2a8a1386ddc1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:34.063173 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e82c9762-bad2-4ff8-ac79-2a8a1386ddc1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:34.063173 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e82c9762-bad2-4ff8-ac79-2a8a1386ddc1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:34.063783 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e82c9762-bad2-4ff8-ac79-2a8a1386ddc1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:34.213515 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e82c9762-bad2-4ff8-ac79-2a8a1386ddc1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:34.221683 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e82c9762-bad2-4ff8-ac79-2a8a1386ddc1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1679 microversion: 2.1 time: 0.177114 Aug 29 21:59:34.222270 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 528/1062] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:34 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:59:35.244618 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e3abeb3c-c6d2-480d-8009-0a03478cc9f7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:35.245264 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-e3abeb3c-c6d2-480d-8009-0a03478cc9f7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:35.251818 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e3abeb3c-c6d2-480d-8009-0a03478cc9f7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:35.252306 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e3abeb3c-c6d2-480d-8009-0a03478cc9f7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:35.252789 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e3abeb3c-c6d2-480d-8009-0a03478cc9f7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:35.253565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e3abeb3c-c6d2-480d-8009-0a03478cc9f7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:35.254023 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e3abeb3c-c6d2-480d-8009-0a03478cc9f7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:35.254455 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-e3abeb3c-c6d2-480d-8009-0a03478cc9f7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:35.335007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-e3abeb3c-c6d2-480d-8009-0a03478cc9f7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:35.343161 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e3abeb3c-c6d2-480d-8009-0a03478cc9f7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1612 microversion: 2.1 time: 0.102515 Aug 29 21:59:35.343745 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 535/1063] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:35 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1612 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 21:59:35.599962 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-83e95c44-1d0f-47b8-a51a-9c50e9c2f2a1 req-7fe6b25c-68a3-491b-85ca-4886fe945e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9af2023-7f55-4a86-b266-b2c6e8ec7878", "name": "network-vif-deleted", "tag": "5e1bed99-3c35-45a7-85e6-5d7f697b0eb3"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:59:35.610228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-83e95c44-1d0f-47b8-a51a-9c50e9c2f2a1 req-7fe6b25c-68a3-491b-85ca-4886fe945e42 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:35.614220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-83e95c44-1d0f-47b8-a51a-9c50e9c2f2a1 req-7fe6b25c-68a3-491b-85ca-4886fe945e42 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:35.614220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-83e95c44-1d0f-47b8-a51a-9c50e9c2f2a1 req-7fe6b25c-68a3-491b-85ca-4886fe945e42 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:35.623220 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-83e95c44-1d0f-47b8-a51a-9c50e9c2f2a1 req-7fe6b25c-68a3-491b-85ca-4886fe945e42 service nova] Creating event network-vif-deleted:5e1bed99-3c35-45a7-85e6-5d7f697b0eb3 for instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 on hv-cinder-85426 Aug 29 21:59:35.628303 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-83e95c44-1d0f-47b8-a51a-9c50e9c2f2a1 req-7fe6b25c-68a3-491b-85ca-4886fe945e42 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032594 Aug 29 21:59:35.629123 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 529/1064] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:59:36.365686 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-74141e71-b53b-40b0-8c14-e644a44d88c4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:36.366361 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-74141e71-b53b-40b0-8c14-e644a44d88c4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:36.373766 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-74141e71-b53b-40b0-8c14-e644a44d88c4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:36.374261 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-74141e71-b53b-40b0-8c14-e644a44d88c4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:36.374704 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-74141e71-b53b-40b0-8c14-e644a44d88c4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:36.375413 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-74141e71-b53b-40b0-8c14-e644a44d88c4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:36.375872 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-74141e71-b53b-40b0-8c14-e644a44d88c4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:36.376295 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-74141e71-b53b-40b0-8c14-e644a44d88c4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:36.412217 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-74141e71-b53b-40b0-8c14-e644a44d88c4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:36.412822 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-74141e71-b53b-40b0-8c14-e644a44d88c4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:36.413198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-74141e71-b53b-40b0-8c14-e644a44d88c4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:36.413660 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.objects.instance [None req-74141e71-b53b-40b0-8c14-e644a44d88c4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lazy-loading 'fault' on Instance uuid b9af2023-7f55-4a86-b266-b2c6e8ec7878 {{(pid=127882) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:59:36.463634 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-74141e71-b53b-40b0-8c14-e644a44d88c4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:36.471962 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-74141e71-b53b-40b0-8c14-e644a44d88c4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 200 len: 1330 microversion: 2.1 time: 0.111043 Aug 29 21:59:36.476773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 536/1065] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:36 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:59:37.494313 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-fc34effc-3ac4-46b8-b0ac-05a879e8ebfd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:37.494993 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-fc34effc-3ac4-46b8-b0ac-05a879e8ebfd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:37.501750 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fc34effc-3ac4-46b8-b0ac-05a879e8ebfd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:37.502245 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fc34effc-3ac4-46b8-b0ac-05a879e8ebfd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:37.502688 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fc34effc-3ac4-46b8-b0ac-05a879e8ebfd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:37.503398 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fc34effc-3ac4-46b8-b0ac-05a879e8ebfd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:37.503860 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fc34effc-3ac4-46b8-b0ac-05a879e8ebfd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:37.504797 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-fc34effc-3ac4-46b8-b0ac-05a879e8ebfd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:37.522437 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-fc34effc-3ac4-46b8-b0ac-05a879e8ebfd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] HTTP exception thrown: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-fc34effc-3ac4-46b8-b0ac-05a879e8ebfd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Request method failure captured: Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 HTTP/1.1 Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTZLVEObYhy0XvUUBWReeF5_kugi_bGrw2NNDFt07_UsV3pUzA3h3sIgkCsJDb8h6RjVLqb8H4JpVV6TDe-f8caIDdu7ab4GDnUrNqI-5GJXbQUYIEbL-eXnbUDWZ_kWZwPzrCKTL6HNsAkc49EWegEnggwEm8jJ-obMU_4_tuUcdeo Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 21:59:37.524310 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 21:59:37.526050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_926837c28a3743deab8a4849571ecd19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/926837c28a3743deab8a4849571ecd19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:59:37.526050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-AttachVolumeNegativeTest-671996841 Aug 29 21:59:37.526050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 21:59:37.526050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 21:59:37.526050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 21:59:37.526050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 21:59:37.526050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 21:59:37.526050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 3a878450743f4843a5e8cc04ca94184d Aug 29 21:59:37.526050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 21:59:37.526050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 21:59:37.526050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. Aug 29 21:59:37.526050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': 'b9af2023-7f55-4a86-b266-b2c6e8ec7878'} Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:59:37.527062 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. Aug 29 21:59:37.528653 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 21:59:37.530100 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-fc34effc-3ac4-46b8-b0ac-05a879e8ebfd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Returning 404 to user: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:59:37.530100 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-fc34effc-3ac4-46b8-b0ac-05a879e8ebfd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 404 len: 111 microversion: 2.1 time: 0.035649 Aug 29 21:59:37.530100 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 530/1066] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:37 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:59:37.534478 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-91e76c0f-6b85-4e81-838c-884204c8b6bd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '.version_select at 0x7f50408d4b80>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:37.647361 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-91e76c0f-6b85-4e81-838c-884204c8b6bd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-537047581" status: 202 len: 0 microversion: 2.1 time: 0.116567 Aug 29 21:59:37.647944 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 537/1067] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 21:59:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-537047581 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:59:38.545329 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-62b328ca-6408-46ec-9e9d-5bfebd79cabf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:38.546077 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-62b328ca-6408-46ec-9e9d-5bfebd79cabf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:38.553455 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-62b328ca-6408-46ec-9e9d-5bfebd79cabf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:38.553947 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-62b328ca-6408-46ec-9e9d-5bfebd79cabf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:38.554389 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-62b328ca-6408-46ec-9e9d-5bfebd79cabf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:38.555093 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-62b328ca-6408-46ec-9e9d-5bfebd79cabf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:38.555549 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-62b328ca-6408-46ec-9e9d-5bfebd79cabf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:38.555975 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-62b328ca-6408-46ec-9e9d-5bfebd79cabf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:38.641937 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-62b328ca-6408-46ec-9e9d-5bfebd79cabf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lazy-loading 'services' on Instance uuid 45e3043f-0e5d-4928-9291-6b86323fa54b {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:59:38.856469 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-62b328ca-6408-46ec-9e9d-5bfebd79cabf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "DELETE /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b/os-volume_attachments/0c4b604d-5ddc-4b36-ba0f-195af89d6400" status: 202 len: 0 microversion: 2.1 time: 0.314897 Aug 29 21:59:38.859230 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 531/1068] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 21:59:38 2022] DELETE /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b/os-volume_attachments/0c4b604d-5ddc-4b36-ba0f-195af89d6400 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:59:38.866472 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-93d79ed2-71b2-4e86-843f-07601731ceb9 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:38.868926 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-93d79ed2-71b2-4e86-843f-07601731ceb9 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:38.875798 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-93d79ed2-71b2-4e86-843f-07601731ceb9 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:38.876289 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-93d79ed2-71b2-4e86-843f-07601731ceb9 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:38.876762 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-93d79ed2-71b2-4e86-843f-07601731ceb9 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:38.877492 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-93d79ed2-71b2-4e86-843f-07601731ceb9 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:38.878058 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-93d79ed2-71b2-4e86-843f-07601731ceb9 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:38.878490 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-93d79ed2-71b2-4e86-843f-07601731ceb9 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:38.910481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-93d79ed2-71b2-4e86-843f-07601731ceb9 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048742 Aug 29 21:59:38.911056 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 538/1069] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 21:59:38 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:59:39.924049 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-11fb1484-c490-413c-a069-360f68351800 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:39.927050 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-11fb1484-c490-413c-a069-360f68351800 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:39.934798 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-11fb1484-c490-413c-a069-360f68351800 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:39.935299 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-11fb1484-c490-413c-a069-360f68351800 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:39.935794 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-11fb1484-c490-413c-a069-360f68351800 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:39.936529 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-11fb1484-c490-413c-a069-360f68351800 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:39.937003 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-11fb1484-c490-413c-a069-360f68351800 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:39.944856 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-11fb1484-c490-413c-a069-360f68351800 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:39.968953 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-11fb1484-c490-413c-a069-360f68351800 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049246 Aug 29 21:59:39.969564 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 532/1070] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 21:59:39 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 21:59:40.043573 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-70fa6e90-0b28-4541-94d9-d05ffbf739be tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:40.044245 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-70fa6e90-0b28-4541-94d9-d05ffbf739be tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:40.050900 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-70fa6e90-0b28-4541-94d9-d05ffbf739be tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:40.051887 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-70fa6e90-0b28-4541-94d9-d05ffbf739be tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:40.052327 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-70fa6e90-0b28-4541-94d9-d05ffbf739be tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:40.053327 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-70fa6e90-0b28-4541-94d9-d05ffbf739be tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:40.053797 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-70fa6e90-0b28-4541-94d9-d05ffbf739be tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:40.054224 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-70fa6e90-0b28-4541-94d9-d05ffbf739be tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:40.081414 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-70fa6e90-0b28-4541-94d9-d05ffbf739be tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Going to try to terminate instance {{(pid=127882) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 21:59:40.359412 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-70fa6e90-0b28-4541-94d9-d05ffbf739be tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "DELETE /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 204 len: 0 microversion: 2.1 time: 0.319478 Aug 29 21:59:40.360018 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 539/1071] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 21:59:40 2022] DELETE /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 21:59:40.368186 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-f4aa18fa-223b-45c1-af22-9c266accbbe7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:40.368843 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-f4aa18fa-223b-45c1-af22-9c266accbbe7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:40.375078 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f4aa18fa-223b-45c1-af22-9c266accbbe7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:40.375570 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f4aa18fa-223b-45c1-af22-9c266accbbe7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:40.376023 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f4aa18fa-223b-45c1-af22-9c266accbbe7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:40.376739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f4aa18fa-223b-45c1-af22-9c266accbbe7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:40.377195 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f4aa18fa-223b-45c1-af22-9c266accbbe7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:40.377620 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-f4aa18fa-223b-45c1-af22-9c266accbbe7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:40.517800 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-f4aa18fa-223b-45c1-af22-9c266accbbe7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:40.528249 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f4aa18fa-223b-45c1-af22-9c266accbbe7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1682 microversion: 2.1 time: 0.163780 Aug 29 21:59:40.528856 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 533/1072] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:40 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:59:41.550350 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a68e4d57-3541-4c73-b1f8-af8736847e52 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:41.551043 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a68e4d57-3541-4c73-b1f8-af8736847e52 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:41.558491 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a68e4d57-3541-4c73-b1f8-af8736847e52 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:41.559070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a68e4d57-3541-4c73-b1f8-af8736847e52 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:41.559432 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a68e4d57-3541-4c73-b1f8-af8736847e52 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:41.560220 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a68e4d57-3541-4c73-b1f8-af8736847e52 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:41.560711 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a68e4d57-3541-4c73-b1f8-af8736847e52 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:41.561137 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a68e4d57-3541-4c73-b1f8-af8736847e52 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:41.696089 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a68e4d57-3541-4c73-b1f8-af8736847e52 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:41.704117 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a68e4d57-3541-4c73-b1f8-af8736847e52 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1682 microversion: 2.1 time: 0.158150 Aug 29 21:59:41.704723 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 540/1073] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:41 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:59:42.727131 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7fdd8df6-3819-4e57-8f7c-c55458919569 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:42.727786 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7fdd8df6-3819-4e57-8f7c-c55458919569 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:42.735303 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7fdd8df6-3819-4e57-8f7c-c55458919569 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:42.735791 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7fdd8df6-3819-4e57-8f7c-c55458919569 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:42.736225 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7fdd8df6-3819-4e57-8f7c-c55458919569 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:42.736976 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7fdd8df6-3819-4e57-8f7c-c55458919569 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:42.737424 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7fdd8df6-3819-4e57-8f7c-c55458919569 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:42.737846 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7fdd8df6-3819-4e57-8f7c-c55458919569 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:43.076983 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7fdd8df6-3819-4e57-8f7c-c55458919569 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:43.087528 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7fdd8df6-3819-4e57-8f7c-c55458919569 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1682 microversion: 2.1 time: 0.365108 Aug 29 21:59:43.099686 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 534/1074] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:42 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1682 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:59:43.361971 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-703449b3-f6ac-4945-b700-f8d91fb562c7 req-5425bdd2-dfc9-474e-aab0-1023c76674cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e3043f-0e5d-4928-9291-6b86323fa54b", "name": "network-vif-deleted", "tag": "77872bd0-cbd9-40b8-b1e6-ffb4bb82eead"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:59:43.372029 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-703449b3-f6ac-4945-b700-f8d91fb562c7 req-5425bdd2-dfc9-474e-aab0-1023c76674cc service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:43.372824 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-703449b3-f6ac-4945-b700-f8d91fb562c7 req-5425bdd2-dfc9-474e-aab0-1023c76674cc service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:43.380198 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-703449b3-f6ac-4945-b700-f8d91fb562c7 req-5425bdd2-dfc9-474e-aab0-1023c76674cc service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:43.386736 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-703449b3-f6ac-4945-b700-f8d91fb562c7 req-5425bdd2-dfc9-474e-aab0-1023c76674cc service nova] Creating event network-vif-deleted:77872bd0-cbd9-40b8-b1e6-ffb4bb82eead for instance 45e3043f-0e5d-4928-9291-6b86323fa54b on hv-cinder-85426 Aug 29 21:59:43.392766 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-703449b3-f6ac-4945-b700-f8d91fb562c7 req-5425bdd2-dfc9-474e-aab0-1023c76674cc service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034596 Aug 29 21:59:43.393799 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 541/1075] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:59:44.110223 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8e8968b3-2b0f-40bd-8f5c-9c94eaf1e418 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:44.110848 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-8e8968b3-2b0f-40bd-8f5c-9c94eaf1e418 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:44.120173 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e8968b3-2b0f-40bd-8f5c-9c94eaf1e418 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:44.120978 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e8968b3-2b0f-40bd-8f5c-9c94eaf1e418 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:44.121601 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e8968b3-2b0f-40bd-8f5c-9c94eaf1e418 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:44.122872 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e8968b3-2b0f-40bd-8f5c-9c94eaf1e418 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:44.123235 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e8968b3-2b0f-40bd-8f5c-9c94eaf1e418 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:44.123865 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e8968b3-2b0f-40bd-8f5c-9c94eaf1e418 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:44.157929 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e8968b3-2b0f-40bd-8f5c-9c94eaf1e418 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:44.158419 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e8968b3-2b0f-40bd-8f5c-9c94eaf1e418 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:44.158858 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8e8968b3-2b0f-40bd-8f5c-9c94eaf1e418 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:44.159316 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-8e8968b3-2b0f-40bd-8f5c-9c94eaf1e418 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lazy-loading 'fault' on Instance uuid 45e3043f-0e5d-4928-9291-6b86323fa54b {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 21:59:44.206517 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-8e8968b3-2b0f-40bd-8f5c-9c94eaf1e418 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:44.216316 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-8e8968b3-2b0f-40bd-8f5c-9c94eaf1e418 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 200 len: 1332 microversion: 2.1 time: 0.109994 Aug 29 21:59:44.217054 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 535/1076] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:44 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:59:45.240861 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-bd2b91f2-8089-4031-9450-197e1287c8eb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:45.240861 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-bd2b91f2-8089-4031-9450-197e1287c8eb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:45.247463 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bd2b91f2-8089-4031-9450-197e1287c8eb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:45.247685 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bd2b91f2-8089-4031-9450-197e1287c8eb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:45.253688 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bd2b91f2-8089-4031-9450-197e1287c8eb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:45.253688 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bd2b91f2-8089-4031-9450-197e1287c8eb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:45.253688 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bd2b91f2-8089-4031-9450-197e1287c8eb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:45.253688 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-bd2b91f2-8089-4031-9450-197e1287c8eb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:45.265039 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-bd2b91f2-8089-4031-9450-197e1287c8eb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] HTTP exception thrown: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-bd2b91f2-8089-4031-9450-197e1287c8eb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Request method failure captured: Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b HTTP/1.1 Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTZLVEObYhy0XvUUBWReeF5_kugi_bGrw2NNDFt07_UsV3pUzA3h3sIgkCsJDb8h6RjVLqb8H4JpVV6TDe-f8caIDdu7ab4GDnUrNqI-5GJXbQUYIEbL-eXnbUDWZ_kWZwPzrCKTL6HNsAkc49EWegEnggwEm8jJ-obMU_4_tuUcdeo Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 21:59:45.266741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 21:59:45.268303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_926837c28a3743deab8a4849571ecd19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/926837c28a3743deab8a4849571ecd19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 21:59:45.268303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeNegativeTest-671996841 Aug 29 21:59:45.268303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 21:59:45.268303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 21:59:45.268303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 21:59:45.268303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 21:59:45.268303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 21:59:45.268303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 3a878450743f4843a5e8cc04ca94184d Aug 29 21:59:45.268303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 21:59:45.268303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 21:59:45.268303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. Aug 29 21:59:45.268303 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '45e3043f-0e5d-4928-9291-6b86323fa54b'} Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 21:59:45.269265 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. Aug 29 21:59:45.271069 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 21:59:45.272519 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-bd2b91f2-8089-4031-9450-197e1287c8eb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Returning 404 to user: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 21:59:45.272519 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-bd2b91f2-8089-4031-9450-197e1287c8eb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 404 len: 111 microversion: 2.1 time: 0.034055 Aug 29 21:59:45.272519 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 542/1077] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:45 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 21:59:45.280320 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-fad86845-3d94-4a43-a086-555bcf4c83bf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '.version_select at 0x7f5040503a60>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:45.361566 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-fad86845-3d94-4a43-a086-555bcf4c83bf tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300980635" status: 202 len: 0 microversion: 2.1 time: 0.086008 Aug 29 21:59:45.362150 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 536/1078] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 21:59:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300980635 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 21:59:46.178235 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-e936a588-bc14-44d8-a369-6e3533e7ebb5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Action: 'create', calling method: .version_select at 0x7f50405dc3a0>, body: {"keypair": {"name": "tempest-keypair-1909018943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDw867XUefYupiJmOJI3m0ItdP/6+DkeraLgO5DkrvsL2zoTsvgurM1SwuoJmVW2LiM4otw/xhOz1aA2cVbr3u8hrUIBu53oe6KoKx40VsE8IDU8T4feKVqySnG7WDz5Q=="}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:59:46.194007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-e936a588-bc14-44d8-a369-6e3533e7ebb5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for project 926837c28a3743deab8a4849571ecd19. Resources: {'key_pairs'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:59:46.197913 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-e936a588-bc14-44d8-a369-6e3533e7ebb5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for user 3a878450743f4843a5e8cc04ca94184d and project 926837c28a3743deab8a4849571ecd19. Resources: {'key_pairs'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:59:46.327335 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-e936a588-bc14-44d8-a369-6e3533e7ebb5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.153398 Aug 29 21:59:46.328002 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 543/1079] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 21:59:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:59:48.809547 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1434908194", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffd5a48c-ee26-4008-a0d2-7fefac315aca"}], "security_groups": [{"name": "tempest-securitygroup--2031535679"}], "key_name": "tempest-keypair-1909018943", "user_data": "}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:59:48.921042 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.network.neutron [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] validate_networks() for [('ffd5a48c-ee26-4008-a0d2-7fefac315aca', None, None, None, None, None)] {{(pid=127883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 21:59:49.428575 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Flavor limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 21:59:49.429008 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Image limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 21:59:49.429488 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Flavor pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 21:59:49.429930 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Image pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 21:59:49.430504 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 21:59:49.439696 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:49.440181 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:49.440657 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:49.441390 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:49.442016 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:49.442447 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:49.461088 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for project 926837c28a3743deab8a4849571ecd19. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 21:59:49.465727 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for user 3a878450743f4843a5e8cc04ca94184d and project 926837c28a3743deab8a4849571ecd19. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 21:59:49.478121 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Going to run 1 instances... {{(pid=127883) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 21:59:49.480471 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 21:59:49.835361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-5aa28501-b3ae-4f99-9205-3dd5c7d41c75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.030584 Aug 29 21:59:49.836402 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 537/1080] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 21:59:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 21:59:49.848070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-684a546a-5579-42fc-aa5a-a8684a5b49b7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:49.849451 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-684a546a-5579-42fc-aa5a-a8684a5b49b7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:49.912411 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-684a546a-5579-42fc-aa5a-a8684a5b49b7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:49.919436 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-684a546a-5579-42fc-aa5a-a8684a5b49b7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1242 microversion: 2.1 time: 0.075846 Aug 29 21:59:49.919998 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 544/1081] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:49 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:59:50.945214 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-aa1e1ae8-2612-4e53-a6e8-ea46fb5ed17d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:50.946290 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-aa1e1ae8-2612-4e53-a6e8-ea46fb5ed17d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:51.017175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-aa1e1ae8-2612-4e53-a6e8-ea46fb5ed17d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:51.025581 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-aa1e1ae8-2612-4e53-a6e8-ea46fb5ed17d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1242 microversion: 2.1 time: 0.087943 Aug 29 21:59:51.026223 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 538/1082] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:50 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:59:52.046879 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-fc346f19-7307-47b1-b57c-3f772049b028 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:52.047487 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-fc346f19-7307-47b1-b57c-3f772049b028 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:52.126262 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-fc346f19-7307-47b1-b57c-3f772049b028 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:52.134710 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-fc346f19-7307-47b1-b57c-3f772049b028 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1242 microversion: 2.1 time: 0.091679 Aug 29 21:59:52.135317 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 545/1083] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:52 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:59:53.155786 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-3fd548e9-a7c5-4dac-8d29-86382a3476a4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:53.156388 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-3fd548e9-a7c5-4dac-8d29-86382a3476a4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:53.212903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-3fd548e9-a7c5-4dac-8d29-86382a3476a4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:53.219909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-3fd548e9-a7c5-4dac-8d29-86382a3476a4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1242 microversion: 2.1 time: 0.068059 Aug 29 21:59:53.220996 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 539/1084] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:53 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:59:54.243121 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-12dbdf9e-2970-49ad-80b7-9041a934863e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:54.243841 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-12dbdf9e-2970-49ad-80b7-9041a934863e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:54.251741 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12dbdf9e-2970-49ad-80b7-9041a934863e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:54.252230 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12dbdf9e-2970-49ad-80b7-9041a934863e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:54.252717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12dbdf9e-2970-49ad-80b7-9041a934863e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:54.253429 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12dbdf9e-2970-49ad-80b7-9041a934863e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:54.253887 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12dbdf9e-2970-49ad-80b7-9041a934863e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:54.254465 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-12dbdf9e-2970-49ad-80b7-9041a934863e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:54.320758 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-12dbdf9e-2970-49ad-80b7-9041a934863e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:54.328515 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-12dbdf9e-2970-49ad-80b7-9041a934863e tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1246 microversion: 2.1 time: 0.091324 Aug 29 21:59:54.329077 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 546/1085] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:54 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:59:55.351089 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-e731429c-bfec-4f49-9191-27a3650d76ae tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:55.351859 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-e731429c-bfec-4f49-9191-27a3650d76ae tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:55.360864 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e731429c-bfec-4f49-9191-27a3650d76ae tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:55.361433 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e731429c-bfec-4f49-9191-27a3650d76ae tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:55.361955 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e731429c-bfec-4f49-9191-27a3650d76ae tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:55.362751 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e731429c-bfec-4f49-9191-27a3650d76ae tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:55.363304 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e731429c-bfec-4f49-9191-27a3650d76ae tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:55.363821 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-e731429c-bfec-4f49-9191-27a3650d76ae tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:55.439711 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-e731429c-bfec-4f49-9191-27a3650d76ae tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:55.448615 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-e731429c-bfec-4f49-9191-27a3650d76ae tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1238 microversion: 2.1 time: 0.102505 Aug 29 21:59:55.452765 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 540/1086] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:55 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1238 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:59:56.471520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c457a823-b5f6-4d6b-b4b7-bcccd8f5f627 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:56.472051 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c457a823-b5f6-4d6b-b4b7-bcccd8f5f627 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:56.484182 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c457a823-b5f6-4d6b-b4b7-bcccd8f5f627 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:56.484182 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c457a823-b5f6-4d6b-b4b7-bcccd8f5f627 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:56.484182 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c457a823-b5f6-4d6b-b4b7-bcccd8f5f627 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:56.484182 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c457a823-b5f6-4d6b-b4b7-bcccd8f5f627 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:56.484645 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c457a823-b5f6-4d6b-b4b7-bcccd8f5f627 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:56.484645 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c457a823-b5f6-4d6b-b4b7-bcccd8f5f627 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:56.549099 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c457a823-b5f6-4d6b-b4b7-bcccd8f5f627 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:56.557652 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c457a823-b5f6-4d6b-b4b7-bcccd8f5f627 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1302 microversion: 2.1 time: 0.090046 Aug 29 21:59:56.558259 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 547/1087] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:56 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1302 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:59:57.580889 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-eb336fa3-124f-4fc5-9365-7a67e6511377 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:57.581624 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-eb336fa3-124f-4fc5-9365-7a67e6511377 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:57.588163 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eb336fa3-124f-4fc5-9365-7a67e6511377 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:57.588798 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eb336fa3-124f-4fc5-9365-7a67e6511377 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:57.589246 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eb336fa3-124f-4fc5-9365-7a67e6511377 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:57.589970 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eb336fa3-124f-4fc5-9365-7a67e6511377 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:57.590426 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eb336fa3-124f-4fc5-9365-7a67e6511377 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:57.590858 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-eb336fa3-124f-4fc5-9365-7a67e6511377 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:57.807816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-eb336fa3-124f-4fc5-9365-7a67e6511377 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:57.815854 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-eb336fa3-124f-4fc5-9365-7a67e6511377 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1368 microversion: 2.1 time: 0.240107 Aug 29 21:59:57.816468 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 541/1088] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:57 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 21:59:58.184437 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-5db61265-fbea-48d1-aaf6-6515e74100bd req-ec4d3026-e943-4c75-94ad-c74f6e73dda3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4922b97b-c90d-4573-985b-1670a879795b", "tag": "3fa75209-b93e-43f6-9fe2-412a1a219328"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 21:59:58.227055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-5db61265-fbea-48d1-aaf6-6515e74100bd req-ec4d3026-e943-4c75-94ad-c74f6e73dda3 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:58.227055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-5db61265-fbea-48d1-aaf6-6515e74100bd req-ec4d3026-e943-4c75-94ad-c74f6e73dda3 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:58.227055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-5db61265-fbea-48d1-aaf6-6515e74100bd req-ec4d3026-e943-4c75-94ad-c74f6e73dda3 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:58.227055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-5db61265-fbea-48d1-aaf6-6515e74100bd req-ec4d3026-e943-4c75-94ad-c74f6e73dda3 service nova] Creating event network-changed:3fa75209-b93e-43f6-9fe2-412a1a219328 for instance 4922b97b-c90d-4573-985b-1670a879795b on hv-cinder-85426 Aug 29 21:59:58.227055 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-5db61265-fbea-48d1-aaf6-6515e74100bd req-ec4d3026-e943-4c75-94ad-c74f6e73dda3 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041088 Aug 29 21:59:58.227972 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 548/1089] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 21:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 21:59:58.839728 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-32c2ed2e-88be-44d8-a35b-5dbb3e248b0b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 21:59:58.840417 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-32c2ed2e-88be-44d8-a35b-5dbb3e248b0b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 21:59:58.847663 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-32c2ed2e-88be-44d8-a35b-5dbb3e248b0b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:58.848179 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-32c2ed2e-88be-44d8-a35b-5dbb3e248b0b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:58.848681 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-32c2ed2e-88be-44d8-a35b-5dbb3e248b0b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:58.849516 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-32c2ed2e-88be-44d8-a35b-5dbb3e248b0b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 21:59:58.850010 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-32c2ed2e-88be-44d8-a35b-5dbb3e248b0b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 21:59:58.850473 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-32c2ed2e-88be-44d8-a35b-5dbb3e248b0b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 21:59:59.090143 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-32c2ed2e-88be-44d8-a35b-5dbb3e248b0b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 21:59:59.103110 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-32c2ed2e-88be-44d8-a35b-5dbb3e248b0b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1368 microversion: 2.1 time: 0.267475 Aug 29 21:59:59.103739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 542/1090] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 21:59:58 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:00:00.126582 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c9f6199d-95e6-4a60-a1ce-36c313d44550 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:00.127320 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c9f6199d-95e6-4a60-a1ce-36c313d44550 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:00.134895 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c9f6199d-95e6-4a60-a1ce-36c313d44550 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:00.135389 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c9f6199d-95e6-4a60-a1ce-36c313d44550 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:00.135829 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c9f6199d-95e6-4a60-a1ce-36c313d44550 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:00.136570 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c9f6199d-95e6-4a60-a1ce-36c313d44550 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:00.137031 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c9f6199d-95e6-4a60-a1ce-36c313d44550 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:00.137461 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c9f6199d-95e6-4a60-a1ce-36c313d44550 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:00.277072 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-c9f6199d-95e6-4a60-a1ce-36c313d44550 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:00:00.285115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c9f6199d-95e6-4a60-a1ce-36c313d44550 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1368 microversion: 2.1 time: 0.163329 Aug 29 22:00:00.285716 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 549/1091] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:00:00 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:00:01.306609 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-12ce34be-b9f8-4690-a854-33f46a26dd1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:01.307282 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-12ce34be-b9f8-4690-a854-33f46a26dd1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:01.309424 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:00:01.315105 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-12ce34be-b9f8-4690-a854-33f46a26dd1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:01.315601 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-12ce34be-b9f8-4690-a854-33f46a26dd1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:01.316043 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-12ce34be-b9f8-4690-a854-33f46a26dd1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:01.317327 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-12ce34be-b9f8-4690-a854-33f46a26dd1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:01.317782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-12ce34be-b9f8-4690-a854-33f46a26dd1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:01.318254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-12ce34be-b9f8-4690-a854-33f46a26dd1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:01.487865 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-12ce34be-b9f8-4690-a854-33f46a26dd1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:00:01.497266 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-12ce34be-b9f8-4690-a854-33f46a26dd1f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1368 microversion: 2.1 time: 0.194705 Aug 29 22:00:01.498004 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 543/1092] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:00:01 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:00:02.520995 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-cbbc9497-9db6-4861-bd28-d84b4b0eeb3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:02.521662 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-cbbc9497-9db6-4861-bd28-d84b4b0eeb3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:02.524330 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=8 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:00:02.525137 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:00:02.532551 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbbc9497-9db6-4861-bd28-d84b4b0eeb3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:02.533087 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbbc9497-9db6-4861-bd28-d84b4b0eeb3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:02.533727 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbbc9497-9db6-4861-bd28-d84b4b0eeb3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:02.534462 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbbc9497-9db6-4861-bd28-d84b4b0eeb3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:02.534915 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbbc9497-9db6-4861-bd28-d84b4b0eeb3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:02.535396 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-cbbc9497-9db6-4861-bd28-d84b4b0eeb3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:02.539422 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:00:02.684858 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-cbbc9497-9db6-4861-bd28-d84b4b0eeb3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:00:02.694205 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-cbbc9497-9db6-4861-bd28-d84b4b0eeb3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1368 microversion: 2.1 time: 0.178019 Aug 29 22:00:02.694798 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 550/1093] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:00:02 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:00:03.243108 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-08f2c009-0c26-4f2b-ae67-22ef49742491 req-b2eae2e8-30dc-4258-a690-10a3db03069d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4922b97b-c90d-4573-985b-1670a879795b", "name": "network-vif-plugged", "status": "completed", "tag": "3fa75209-b93e-43f6-9fe2-412a1a219328"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:00:03.250094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=10 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:00:03.251215 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:00:03.258136 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-08f2c009-0c26-4f2b-ae67-22ef49742491 req-b2eae2e8-30dc-4258-a690-10a3db03069d service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:03.258803 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-08f2c009-0c26-4f2b-ae67-22ef49742491 req-b2eae2e8-30dc-4258-a690-10a3db03069d service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:03.259371 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-08f2c009-0c26-4f2b-ae67-22ef49742491 req-b2eae2e8-30dc-4258-a690-10a3db03069d service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:03.262654 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:00:03.274255 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-08f2c009-0c26-4f2b-ae67-22ef49742491 req-b2eae2e8-30dc-4258-a690-10a3db03069d service nova] Creating event network-vif-plugged:3fa75209-b93e-43f6-9fe2-412a1a219328 for instance 4922b97b-c90d-4573-985b-1670a879795b on hv-cinder-85426 Aug 29 22:00:03.279815 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-08f2c009-0c26-4f2b-ae67-22ef49742491 req-b2eae2e8-30dc-4258-a690-10a3db03069d service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041023 Aug 29 22:00:03.280433 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 544/1094] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 22:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:00:03.715888 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-7c64b4de-8b7b-4cd7-b3cb-ff101e2cab9f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:03.716787 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-7c64b4de-8b7b-4cd7-b3cb-ff101e2cab9f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:03.725135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7c64b4de-8b7b-4cd7-b3cb-ff101e2cab9f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:03.727895 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7c64b4de-8b7b-4cd7-b3cb-ff101e2cab9f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:03.727895 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7c64b4de-8b7b-4cd7-b3cb-ff101e2cab9f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:03.727895 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7c64b4de-8b7b-4cd7-b3cb-ff101e2cab9f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:03.727895 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7c64b4de-8b7b-4cd7-b3cb-ff101e2cab9f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:03.728353 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-7c64b4de-8b7b-4cd7-b3cb-ff101e2cab9f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:03.876562 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-7c64b4de-8b7b-4cd7-b3cb-ff101e2cab9f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:00:03.885884 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-7c64b4de-8b7b-4cd7-b3cb-ff101e2cab9f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1368 microversion: 2.1 time: 0.174336 Aug 29 22:00:03.886483 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 551/1095] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:00:03 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:00:04.909392 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-bee75581-dafc-4c71-b74c-5e2f1b94b74b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:04.985704 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-bee75581-dafc-4c71-b74c-5e2f1b94b74b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:04.985704 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bee75581-dafc-4c71-b74c-5e2f1b94b74b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:04.985704 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bee75581-dafc-4c71-b74c-5e2f1b94b74b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:04.985704 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bee75581-dafc-4c71-b74c-5e2f1b94b74b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:04.986982 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bee75581-dafc-4c71-b74c-5e2f1b94b74b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:04.986982 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bee75581-dafc-4c71-b74c-5e2f1b94b74b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:04.986982 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bee75581-dafc-4c71-b74c-5e2f1b94b74b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:05.075432 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-bee75581-dafc-4c71-b74c-5e2f1b94b74b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:00:05.091942 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-bee75581-dafc-4c71-b74c-5e2f1b94b74b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1558 microversion: 2.1 time: 0.187707 Aug 29 22:00:05.092997 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 545/1096] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:00:04 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:00:05.120946 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-858ee159-aa36-4f53-a696-6e6935889e3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:05.121836 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-858ee159-aa36-4f53-a696-6e6935889e3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:05.138401 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-858ee159-aa36-4f53-a696-6e6935889e3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:05.138869 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-858ee159-aa36-4f53-a696-6e6935889e3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:05.139319 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-858ee159-aa36-4f53-a696-6e6935889e3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:05.140052 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-858ee159-aa36-4f53-a696-6e6935889e3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:05.140564 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-858ee159-aa36-4f53-a696-6e6935889e3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:05.145604 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-858ee159-aa36-4f53-a696-6e6935889e3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:05.234540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-858ee159-aa36-4f53-a696-6e6935889e3f tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117979 Aug 29 22:00:05.235133 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 552/1097] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 22:00:05 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:00:06.343330 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-783a3b4b-a92b-4f39-be3e-faa5eba9b974 req-d2f6e449-61fb-4121-8676-2f4f71166bbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4922b97b-c90d-4573-985b-1670a879795b", "tag": "3fa75209-b93e-43f6-9fe2-412a1a219328"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:00:06.355660 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-783a3b4b-a92b-4f39-be3e-faa5eba9b974 req-d2f6e449-61fb-4121-8676-2f4f71166bbf service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:06.356193 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-783a3b4b-a92b-4f39-be3e-faa5eba9b974 req-d2f6e449-61fb-4121-8676-2f4f71166bbf service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:06.356672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-783a3b4b-a92b-4f39-be3e-faa5eba9b974 req-d2f6e449-61fb-4121-8676-2f4f71166bbf service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:06.370185 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-783a3b4b-a92b-4f39-be3e-faa5eba9b974 req-d2f6e449-61fb-4121-8676-2f4f71166bbf service nova] Creating event network-changed:3fa75209-b93e-43f6-9fe2-412a1a219328 for instance 4922b97b-c90d-4573-985b-1670a879795b on hv-cinder-85426 Aug 29 22:00:06.375726 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-783a3b4b-a92b-4f39-be3e-faa5eba9b974 req-d2f6e449-61fb-4121-8676-2f4f71166bbf service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035984 Aug 29 22:00:06.376385 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 546/1098] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 22:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:00:42.641958 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=5 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:00:42.642793 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=15 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:00:42.646737 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-5e5025ff-4549-44ae-80c6-397dcea21a15 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:42.647266 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-5e5025ff-4549-44ae-80c6-397dcea21a15 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:42.654342 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5e5025ff-4549-44ae-80c6-397dcea21a15 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:42.654838 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5e5025ff-4549-44ae-80c6-397dcea21a15 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:42.655280 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5e5025ff-4549-44ae-80c6-397dcea21a15 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:42.655983 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5e5025ff-4549-44ae-80c6-397dcea21a15 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:42.656439 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5e5025ff-4549-44ae-80c6-397dcea21a15 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:42.656886 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-5e5025ff-4549-44ae-80c6-397dcea21a15 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:42.681201 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-5e5025ff-4549-44ae-80c6-397dcea21a15 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b/ips" status: 200 len: 149 microversion: 2.1 time: 0.040651 Aug 29 22:00:42.684247 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 553/1099] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 22:00:42 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:00:44.324191 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=9 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:00:44.328706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-5322d9dc-13fe-4b47-bf54-3a07ea67d7d7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fb0dbd5-b949-4c1d-a9e9-17bb407e8dcb"}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:00:44.331150 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-5322d9dc-13fe-4b47-bf54-3a07ea67d7d7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:44.338422 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5322d9dc-13fe-4b47-bf54-3a07ea67d7d7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:44.338926 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5322d9dc-13fe-4b47-bf54-3a07ea67d7d7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:44.339359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5322d9dc-13fe-4b47-bf54-3a07ea67d7d7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:44.340067 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5322d9dc-13fe-4b47-bf54-3a07ea67d7d7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:44.340548 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5322d9dc-13fe-4b47-bf54-3a07ea67d7d7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:44.340966 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5322d9dc-13fe-4b47-bf54-3a07ea67d7d7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:45.370627 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-5322d9dc-13fe-4b47-bf54-3a07ea67d7d7 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "POST /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.047798 Aug 29 22:00:45.371342 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 547/1100] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 22:00:44 2022] POST /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b/os-volume_attachments => generated 194 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:00:47.611729 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-26082eec-4537-432c-9667-4fe776e8738d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fb0dbd5-b949-4c1d-a9e9-17bb407e8dcb"}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:00:47.614177 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-26082eec-4537-432c-9667-4fe776e8738d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:47.621812 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-26082eec-4537-432c-9667-4fe776e8738d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:47.622289 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-26082eec-4537-432c-9667-4fe776e8738d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:47.622717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-26082eec-4537-432c-9667-4fe776e8738d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:47.623411 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-26082eec-4537-432c-9667-4fe776e8738d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:47.623859 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-26082eec-4537-432c-9667-4fe776e8738d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:47.624312 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-26082eec-4537-432c-9667-4fe776e8738d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:47.795953 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-26082eec-4537-432c-9667-4fe776e8738d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] HTTP exception thrown: Invalid volume: volume 7fb0dbd5-b949-4c1d-a9e9-17bb407e8dcb is already attached to instances: 4922b97b-c90d-4573-985b-1670a879795b Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-26082eec-4537-432c-9667-4fe776e8738d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Request method failure captured: Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: POST /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b/os-volume_attachments HTTP/1.1 Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 74 Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTZLVEObYhy0XvUUBWReeF5_kugi_bGrw2NNDFt07_UsV3pUzA3h3sIgkCsJDb8h6RjVLqb8H4JpVV6TDe-f8caIDdu7ab4GDnUrNqI-5GJXbQUYIEbL-eXnbUDWZ_kWZwPzrCKTL6HNsAkc49EWegEnggwEm8jJ-obMU_4_tuUcdeo Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 22:00:47.797768 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 22:00:47.799657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_926837c28a3743deab8a4849571ecd19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/926837c28a3743deab8a4849571ecd19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:00:47.799657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:00:47.799657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:00:47.799657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:00:47.799657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:00:47.799657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 22:00:47.799657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 22:00:47.799657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 3a878450743f4843a5e8cc04ca94184d Aug 29 22:00:47.799657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:00:47.799657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Aug 29 22:00:47.799657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {"volumeAttachment": {"volumeId": "7fb0dbd5-b949-4c1d-a9e9-17bb407e8dcb"}} Aug 29 22:00:47.799657 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Invalid volume: volume 7fb0dbd5-b949-4c1d-a9e9-17bb407e8dcb is already attached to instances: 4922b97b-c90d-4573-985b-1670a879795b Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'server_id': '4922b97b-c90d-4573-985b-1670a879795b', 'body': {'volumeAttachment': {'volumeId': '7fb0dbd5-b949-4c1d-a9e9-17bb407e8dcb'}}} Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7fb0dbd5-b949-4c1d-a9e9-17bb407e8dcb is already attached to instances: 4922b97b-c90d-4573-985b-1670a879795b Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:00:47.800808 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7fb0dbd5-b949-4c1d-a9e9-17bb407e8dcb is already attached to instances: 4922b97b-c90d-4573-985b-1670a879795b Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:00:47.802388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:00:47.804129 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:00:47.804129 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:00:47.804129 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:00:47.804129 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7fb0dbd5-b949-4c1d-a9e9-17bb407e8dcb is already attached to instances: 4922b97b-c90d-4573-985b-1670a879795b Aug 29 22:00:47.804129 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:00:47.804129 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-26082eec-4537-432c-9667-4fe776e8738d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Returning 400 to user: Invalid volume: volume 7fb0dbd5-b949-4c1d-a9e9-17bb407e8dcb is already attached to instances: 4922b97b-c90d-4573-985b-1670a879795b {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:00:47.804129 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-26082eec-4537-432c-9667-4fe776e8738d tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "POST /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.193026 Aug 29 22:00:47.804129 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 554/1101] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 22:00:47 2022] POST /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b/os-volume_attachments => generated 174 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:00:47.869258 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-dcd002d9-b6b0-4afc-934c-773327ace433 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:47.869867 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-dcd002d9-b6b0-4afc-934c-773327ace433 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:47.878161 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dcd002d9-b6b0-4afc-934c-773327ace433 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:47.878696 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dcd002d9-b6b0-4afc-934c-773327ace433 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:47.879146 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dcd002d9-b6b0-4afc-934c-773327ace433 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:47.879906 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dcd002d9-b6b0-4afc-934c-773327ace433 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:47.880362 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dcd002d9-b6b0-4afc-934c-773327ace433 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:47.880838 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-dcd002d9-b6b0-4afc-934c-773327ace433 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:47.970711 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-dcd002d9-b6b0-4afc-934c-773327ace433 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lazy-loading 'services' on Instance uuid 4922b97b-c90d-4573-985b-1670a879795b {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:00:48.182144 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-dcd002d9-b6b0-4afc-934c-773327ace433 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "DELETE /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b/os-volume_attachments/7fb0dbd5-b949-4c1d-a9e9-17bb407e8dcb" status: 202 len: 0 microversion: 2.1 time: 0.317983 Aug 29 22:00:48.182746 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 548/1102] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 22:00:47 2022] DELETE /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b/os-volume_attachments/7fb0dbd5-b949-4c1d-a9e9-17bb407e8dcb => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:00:48.191228 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-dced1843-362c-400e-a3e5-b14160906781 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:48.193833 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-dced1843-362c-400e-a3e5-b14160906781 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:48.199915 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dced1843-362c-400e-a3e5-b14160906781 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:48.200437 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dced1843-362c-400e-a3e5-b14160906781 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:48.200914 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dced1843-362c-400e-a3e5-b14160906781 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:48.201664 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dced1843-362c-400e-a3e5-b14160906781 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:48.202054 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dced1843-362c-400e-a3e5-b14160906781 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:48.202469 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-dced1843-362c-400e-a3e5-b14160906781 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:48.233757 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-dced1843-362c-400e-a3e5-b14160906781 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046419 Aug 29 22:00:48.234364 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 555/1103] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 22:00:48 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:00:49.248248 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-c80fc1c3-4f60-46f2-881b-3ac65d639953 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:49.250610 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-c80fc1c3-4f60-46f2-881b-3ac65d639953 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:49.256878 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c80fc1c3-4f60-46f2-881b-3ac65d639953 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:49.257359 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c80fc1c3-4f60-46f2-881b-3ac65d639953 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:49.257791 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c80fc1c3-4f60-46f2-881b-3ac65d639953 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:49.259110 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c80fc1c3-4f60-46f2-881b-3ac65d639953 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:49.259560 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c80fc1c3-4f60-46f2-881b-3ac65d639953 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:49.259984 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-c80fc1c3-4f60-46f2-881b-3ac65d639953 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:49.295233 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-c80fc1c3-4f60-46f2-881b-3ac65d639953 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052409 Aug 29 22:00:49.300184 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 549/1104] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 22:00:49 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:00:49.359845 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-f5f4e5cc-c383-4a37-b100-7900748ec9ec tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:49.363266 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f5f4e5cc-c383-4a37-b100-7900748ec9ec tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:49.368961 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f5f4e5cc-c383-4a37-b100-7900748ec9ec tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:49.369535 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f5f4e5cc-c383-4a37-b100-7900748ec9ec tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:49.369918 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f5f4e5cc-c383-4a37-b100-7900748ec9ec tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:49.370612 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f5f4e5cc-c383-4a37-b100-7900748ec9ec tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:49.371060 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f5f4e5cc-c383-4a37-b100-7900748ec9ec tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:49.371477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-f5f4e5cc-c383-4a37-b100-7900748ec9ec tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:49.398410 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-f5f4e5cc-c383-4a37-b100-7900748ec9ec tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Going to try to terminate instance {{(pid=127882) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:00:49.709526 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-f5f4e5cc-c383-4a37-b100-7900748ec9ec tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "DELETE /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 204 len: 0 microversion: 2.1 time: 0.353146 Aug 29 22:00:49.710031 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 556/1105] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 22:00:49 2022] DELETE /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:00:49.718430 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8b633459-6924-49d0-a734-681fe3141a55 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:49.719240 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-8b633459-6924-49d0-a734-681fe3141a55 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:49.725526 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8b633459-6924-49d0-a734-681fe3141a55 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:49.726017 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8b633459-6924-49d0-a734-681fe3141a55 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:49.726458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8b633459-6924-49d0-a734-681fe3141a55 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:49.727666 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8b633459-6924-49d0-a734-681fe3141a55 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:49.728119 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8b633459-6924-49d0-a734-681fe3141a55 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:49.728571 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8b633459-6924-49d0-a734-681fe3141a55 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:49.871095 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-8b633459-6924-49d0-a734-681fe3141a55 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:00:49.879325 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-8b633459-6924-49d0-a734-681fe3141a55 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1682 microversion: 2.1 time: 0.164752 Aug 29 22:00:49.879909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 550/1106] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:00:49 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:00:50.901584 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-73fcdc64-9292-44be-a77c-6a1bda80b1c2 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:50.902301 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-73fcdc64-9292-44be-a77c-6a1bda80b1c2 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:50.913885 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-73fcdc64-9292-44be-a77c-6a1bda80b1c2 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:50.914388 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-73fcdc64-9292-44be-a77c-6a1bda80b1c2 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:50.914833 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-73fcdc64-9292-44be-a77c-6a1bda80b1c2 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:50.915577 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-73fcdc64-9292-44be-a77c-6a1bda80b1c2 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:50.916020 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-73fcdc64-9292-44be-a77c-6a1bda80b1c2 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:50.916452 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-73fcdc64-9292-44be-a77c-6a1bda80b1c2 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:51.063345 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-73fcdc64-9292-44be-a77c-6a1bda80b1c2 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:00:51.071405 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-73fcdc64-9292-44be-a77c-6a1bda80b1c2 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1682 microversion: 2.1 time: 0.174093 Aug 29 22:00:51.071985 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 557/1107] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:00:50 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:00:52.097522 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-1e314547-a312-43a3-80ed-7e41f737ce7a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:52.098167 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-1e314547-a312-43a3-80ed-7e41f737ce7a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:52.105064 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1e314547-a312-43a3-80ed-7e41f737ce7a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:52.105566 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1e314547-a312-43a3-80ed-7e41f737ce7a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:52.106011 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1e314547-a312-43a3-80ed-7e41f737ce7a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:52.106755 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1e314547-a312-43a3-80ed-7e41f737ce7a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:52.107213 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1e314547-a312-43a3-80ed-7e41f737ce7a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:52.107644 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-1e314547-a312-43a3-80ed-7e41f737ce7a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:52.186296 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-1e314547-a312-43a3-80ed-7e41f737ce7a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:00:52.194335 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-1e314547-a312-43a3-80ed-7e41f737ce7a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1614 microversion: 2.1 time: 0.101434 Aug 29 22:00:52.194926 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 551/1108] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:00:52 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1614 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:00:52.491276 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-a213c174-b40a-4bed-b6b0-ced857bbffec req-331c6d26-06dc-4cbd-a8e3-56aa49728ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4922b97b-c90d-4573-985b-1670a879795b", "name": "network-vif-deleted", "tag": "3fa75209-b93e-43f6-9fe2-412a1a219328"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:00:52.501995 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-a213c174-b40a-4bed-b6b0-ced857bbffec req-331c6d26-06dc-4cbd-a8e3-56aa49728ce0 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:52.502590 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-a213c174-b40a-4bed-b6b0-ced857bbffec req-331c6d26-06dc-4cbd-a8e3-56aa49728ce0 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:52.503174 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-a213c174-b40a-4bed-b6b0-ced857bbffec req-331c6d26-06dc-4cbd-a8e3-56aa49728ce0 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:52.515061 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-a213c174-b40a-4bed-b6b0-ced857bbffec req-331c6d26-06dc-4cbd-a8e3-56aa49728ce0 service nova] Creating event network-vif-deleted:3fa75209-b93e-43f6-9fe2-412a1a219328 for instance 4922b97b-c90d-4573-985b-1670a879795b on hv-cinder-85426 Aug 29 22:00:52.520164 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-a213c174-b40a-4bed-b6b0-ced857bbffec req-331c6d26-06dc-4cbd-a8e3-56aa49728ce0 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032758 Aug 29 22:00:52.520921 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 558/1109] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 22:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:00:53.217355 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-ba4977fd-4ff6-4bd7-a8a2-2870be61c5c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:53.218203 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-ba4977fd-4ff6-4bd7-a8a2-2870be61c5c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:53.225039 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ba4977fd-4ff6-4bd7-a8a2-2870be61c5c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:53.225558 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ba4977fd-4ff6-4bd7-a8a2-2870be61c5c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:53.225998 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ba4977fd-4ff6-4bd7-a8a2-2870be61c5c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:53.226712 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ba4977fd-4ff6-4bd7-a8a2-2870be61c5c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:53.227167 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ba4977fd-4ff6-4bd7-a8a2-2870be61c5c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:53.227590 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ba4977fd-4ff6-4bd7-a8a2-2870be61c5c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:53.263204 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ba4977fd-4ff6-4bd7-a8a2-2870be61c5c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:53.263706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ba4977fd-4ff6-4bd7-a8a2-2870be61c5c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:53.264383 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-ba4977fd-4ff6-4bd7-a8a2-2870be61c5c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:53.264866 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-ba4977fd-4ff6-4bd7-a8a2-2870be61c5c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lazy-loading 'fault' on Instance uuid 4922b97b-c90d-4573-985b-1670a879795b {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:00:53.313099 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-ba4977fd-4ff6-4bd7-a8a2-2870be61c5c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:00:53.323517 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-ba4977fd-4ff6-4bd7-a8a2-2870be61c5c0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 200 len: 1332 microversion: 2.1 time: 0.110048 Aug 29 22:00:53.324527 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 552/1110] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:00:53 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 1332 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:00:54.354560 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ec124097-d2aa-4cf2-b274-463730185287 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:54.355202 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ec124097-d2aa-4cf2-b274-463730185287 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:54.361447 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ec124097-d2aa-4cf2-b274-463730185287 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:54.361944 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ec124097-d2aa-4cf2-b274-463730185287 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:54.362386 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ec124097-d2aa-4cf2-b274-463730185287 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:54.363126 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ec124097-d2aa-4cf2-b274-463730185287 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:54.363540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ec124097-d2aa-4cf2-b274-463730185287 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:54.364065 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ec124097-d2aa-4cf2-b274-463730185287 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:54.377750 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-ec124097-d2aa-4cf2-b274-463730185287 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] HTTP exception thrown: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ec124097-d2aa-4cf2-b274-463730185287 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Request method failure captured: Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b HTTP/1.1 Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTZLVEObYhy0XvUUBWReeF5_kugi_bGrw2NNDFt07_UsV3pUzA3h3sIgkCsJDb8h6RjVLqb8H4JpVV6TDe-f8caIDdu7ab4GDnUrNqI-5GJXbQUYIEbL-eXnbUDWZ_kWZwPzrCKTL6HNsAkc49EWegEnggwEm8jJ-obMU_4_tuUcdeo Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 22:00:54.379470 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 22:00:54.381481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_926837c28a3743deab8a4849571ecd19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/926837c28a3743deab8a4849571ecd19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:00:54.381481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:00:54.381481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:00:54.381481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:00:54.381481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:00:54.381481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 22:00:54.381481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 22:00:54.381481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 3a878450743f4843a5e8cc04ca94184d Aug 29 22:00:54.381481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:00:54.381481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 22:00:54.381481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. Aug 29 22:00:54.381481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '4922b97b-c90d-4573-985b-1670a879795b'} Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:00:54.382698 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. Aug 29 22:00:54.384976 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:00:54.386556 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ec124097-d2aa-4cf2-b274-463730185287 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Returning 404 to user: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:00:54.386556 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ec124097-d2aa-4cf2-b274-463730185287 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 404 len: 111 microversion: 2.1 time: 0.031275 Aug 29 22:00:54.386556 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 559/1111] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:00:54 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:00:54.390850 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-41956114-6b79-40f8-b50a-ae8a507759d5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '.version_select at 0x7f50406fc4c0>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:54.491017 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-41956114-6b79-40f8-b50a-ae8a507759d5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909018943" status: 202 len: 0 microversion: 2.1 time: 0.104121 Aug 29 22:00:54.491586 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 553/1112] 10.222.0.83 () {58 vars in 1221 bytes} [Mon Aug 29 22:00:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909018943 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:00:55.304728 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-89d90ec0-773e-4956-a696-0d858b4d5481 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Action: 'create', calling method: .version_select at 0x7f5040802040>, body: {"keypair": {"name": "tempest-keypair-726093561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUZRHf/uj1P82I/COlgPqkEaNTKi8tdAmLZ31q2E9zye+ihRbXXICHJipLxSRzFH+vwTk6wdGOrJYWgAQHHGMsPcci2bcHR1nTndBL/+oxkH4kMZqN3uMs6JNR+wBc6sQ=="}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:00:55.320344 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-89d90ec0-773e-4956-a696-0d858b4d5481 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for project 926837c28a3743deab8a4849571ecd19. Resources: {'key_pairs'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:00:55.324266 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.quota [None req-89d90ec0-773e-4956-a696-0d858b4d5481 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for user 3a878450743f4843a5e8cc04ca94184d and project 926837c28a3743deab8a4849571ecd19. Resources: {'key_pairs'} {{(pid=127882) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:00:55.402988 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-89d90ec0-773e-4956-a696-0d858b4d5481 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102895 Aug 29 22:00:55.403706 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 560/1113] 10.222.0.83 () {60 vars in 1159 bytes} [Mon Aug 29 22:00:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:00:57.578669 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1985247074", "imageRef": "c420348a-7af8-4a83-893c-9f69e7c1ee77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ffd5a48c-ee26-4008-a0d2-7fefac315aca"}], "security_groups": [{"name": "tempest-securitygroup--719975326"}], "key_name": "tempest-keypair-726093561", "user_data": "}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:00:57.683301 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.network.neutron [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] validate_networks() for [('ffd5a48c-ee26-4008-a0d2-7fefac315aca', None, None, None, None, None)] {{(pid=127883) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:00:58.310002 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Flavor limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:00:58.310424 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Image limits 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:00:58.310897 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Flavor pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:00:58.311305 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Image pref 0:0:0 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:00:58.311714 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.virt.hardware [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127883) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:00:58.320598 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:58.321075 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:58.321503 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:58.322222 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:58.322669 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:58.323094 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:58.339816 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for project 926837c28a3743deab8a4849571ecd19. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:00:58.343800 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.quota [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Getting quotas for user 3a878450743f4843a5e8cc04ca94184d and project 926837c28a3743deab8a4849571ecd19. Resources: {'ram', 'cores', 'instances'} {{(pid=127883) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:00:58.355129 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Going to run 1 instances... {{(pid=127883) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:00:58.357456 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c420348a-7af8-4a83-893c-9f69e7c1ee77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127883) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:00:58.503726 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-100b0612-ba59-4e9b-bd0e-1061f19267bb tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.929945 Aug 29 22:00:58.504453 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 554/1114] 10.222.0.83 () {60 vars in 1147 bytes} [Mon Aug 29 22:00:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:00:58.516616 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ef4a19fc-3be5-4fb5-be9d-54ce97341d75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:58.517253 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ef4a19fc-3be5-4fb5-be9d-54ce97341d75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:58.576596 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-ef4a19fc-3be5-4fb5-be9d-54ce97341d75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:00:58.583786 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ef4a19fc-3be5-4fb5-be9d-54ce97341d75 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 200 len: 1241 microversion: 2.1 time: 0.071825 Aug 29 22:00:58.584374 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 561/1115] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:00:58 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:00:59.606813 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-5d797058-0471-45e3-bb41-3de1d845c714 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:00:59.607435 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-5d797058-0471-45e3-bb41-3de1d845c714 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:00:59.614584 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5d797058-0471-45e3-bb41-3de1d845c714 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:59.615080 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5d797058-0471-45e3-bb41-3de1d845c714 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:59.620276 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5d797058-0471-45e3-bb41-3de1d845c714 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:59.620276 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5d797058-0471-45e3-bb41-3de1d845c714 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:00:59.620276 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5d797058-0471-45e3-bb41-3de1d845c714 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:00:59.620276 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-5d797058-0471-45e3-bb41-3de1d845c714 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:00:59.685391 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-5d797058-0471-45e3-bb41-3de1d845c714 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:00:59.700568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-5d797058-0471-45e3-bb41-3de1d845c714 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 200 len: 1245 microversion: 2.1 time: 0.091812 Aug 29 22:00:59.700568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 555/1116] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:00:59 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:01:00.714561 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6ecd6660-e701-4c77-9036-0375c1598cf1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:00.715621 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-6ecd6660-e701-4c77-9036-0375c1598cf1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:00.722510 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6ecd6660-e701-4c77-9036-0375c1598cf1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:00.722988 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6ecd6660-e701-4c77-9036-0375c1598cf1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:00.723498 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6ecd6660-e701-4c77-9036-0375c1598cf1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:00.724197 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6ecd6660-e701-4c77-9036-0375c1598cf1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:00.724676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6ecd6660-e701-4c77-9036-0375c1598cf1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:00.725558 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-6ecd6660-e701-4c77-9036-0375c1598cf1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:00.795135 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-6ecd6660-e701-4c77-9036-0375c1598cf1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:01:00.802923 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-6ecd6660-e701-4c77-9036-0375c1598cf1 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 200 len: 1301 microversion: 2.1 time: 0.092320 Aug 29 22:01:00.803572 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 562/1117] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:01:00 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 1301 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:01:01.826769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7cc69518-cb7a-454c-b144-61d0206bc40b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:01.827743 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7cc69518-cb7a-454c-b144-61d0206bc40b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:01.837223 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7cc69518-cb7a-454c-b144-61d0206bc40b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:01.837882 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7cc69518-cb7a-454c-b144-61d0206bc40b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:01.838332 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7cc69518-cb7a-454c-b144-61d0206bc40b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:01.839197 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7cc69518-cb7a-454c-b144-61d0206bc40b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:01.839774 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7cc69518-cb7a-454c-b144-61d0206bc40b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:01.840323 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7cc69518-cb7a-454c-b144-61d0206bc40b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:02.014415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-7cc69518-cb7a-454c-b144-61d0206bc40b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:01:02.023026 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7cc69518-cb7a-454c-b144-61d0206bc40b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 200 len: 1366 microversion: 2.1 time: 0.202194 Aug 29 22:01:02.023650 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 556/1118] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:01:01 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:01:02.285820 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-e8580277-8768-49bd-8e6d-51a92df0c72d req-3df5bd5f-6032-44ff-a8d7-3a128f1e9976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1312e41-9aae-4a30-a98e-2b164c5e4f7e", "tag": "3fae8113-afa2-4b2e-a389-c8e987d7744e"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:01:02.296701 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-e8580277-8768-49bd-8e6d-51a92df0c72d req-3df5bd5f-6032-44ff-a8d7-3a128f1e9976 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:02.297186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-e8580277-8768-49bd-8e6d-51a92df0c72d req-3df5bd5f-6032-44ff-a8d7-3a128f1e9976 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:02.297626 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-e8580277-8768-49bd-8e6d-51a92df0c72d req-3df5bd5f-6032-44ff-a8d7-3a128f1e9976 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:02.309819 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-e8580277-8768-49bd-8e6d-51a92df0c72d req-3df5bd5f-6032-44ff-a8d7-3a128f1e9976 service nova] Creating event network-changed:3fae8113-afa2-4b2e-a389-c8e987d7744e for instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e on hv-cinder-85426 Aug 29 22:01:02.315372 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-e8580277-8768-49bd-8e6d-51a92df0c72d req-3df5bd5f-6032-44ff-a8d7-3a128f1e9976 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033289 Aug 29 22:01:02.316089 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 563/1119] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 22:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:01:03.043884 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-3e9f3c87-253f-41d2-a8b9-a8847743afca tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:03.044908 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-3e9f3c87-253f-41d2-a8b9-a8847743afca tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:03.051209 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3e9f3c87-253f-41d2-a8b9-a8847743afca tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:03.051708 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3e9f3c87-253f-41d2-a8b9-a8847743afca tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:03.052133 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3e9f3c87-253f-41d2-a8b9-a8847743afca tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:03.052857 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3e9f3c87-253f-41d2-a8b9-a8847743afca tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:03.053311 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3e9f3c87-253f-41d2-a8b9-a8847743afca tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:03.053733 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-3e9f3c87-253f-41d2-a8b9-a8847743afca tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:03.191256 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-3e9f3c87-253f-41d2-a8b9-a8847743afca tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:01:03.200409 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-3e9f3c87-253f-41d2-a8b9-a8847743afca tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 200 len: 1366 microversion: 2.1 time: 0.160352 Aug 29 22:01:03.201009 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 557/1120] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:01:03 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:01:04.222660 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-32462202-6a29-4009-b50c-d1198e14d08c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:04.223338 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-32462202-6a29-4009-b50c-d1198e14d08c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:04.230100 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-32462202-6a29-4009-b50c-d1198e14d08c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:04.230581 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-32462202-6a29-4009-b50c-d1198e14d08c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:04.231014 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-32462202-6a29-4009-b50c-d1198e14d08c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:04.231693 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-32462202-6a29-4009-b50c-d1198e14d08c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:04.232141 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-32462202-6a29-4009-b50c-d1198e14d08c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:04.232592 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-32462202-6a29-4009-b50c-d1198e14d08c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:04.371413 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-32462202-6a29-4009-b50c-d1198e14d08c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:01:04.379102 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-32462202-6a29-4009-b50c-d1198e14d08c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 200 len: 1366 microversion: 2.1 time: 0.161103 Aug 29 22:01:04.379676 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 564/1121] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:01:04 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:01:05.399494 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-718b211e-2f05-4ff4-884b-94471105f17a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:05.400093 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-718b211e-2f05-4ff4-884b-94471105f17a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:05.406896 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-718b211e-2f05-4ff4-884b-94471105f17a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:05.407563 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-718b211e-2f05-4ff4-884b-94471105f17a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:05.407823 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-718b211e-2f05-4ff4-884b-94471105f17a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:05.408560 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-718b211e-2f05-4ff4-884b-94471105f17a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:05.409021 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-718b211e-2f05-4ff4-884b-94471105f17a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:05.409443 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-718b211e-2f05-4ff4-884b-94471105f17a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:05.549235 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-718b211e-2f05-4ff4-884b-94471105f17a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:01:05.558462 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-718b211e-2f05-4ff4-884b-94471105f17a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 200 len: 1366 microversion: 2.1 time: 0.163007 Aug 29 22:01:05.560085 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 558/1122] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:01:05 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:01:06.579352 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-9fa21ebd-a264-4f54-98a7-c6c99feb40a5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:06.580010 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-9fa21ebd-a264-4f54-98a7-c6c99feb40a5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:06.587320 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9fa21ebd-a264-4f54-98a7-c6c99feb40a5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:06.587806 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9fa21ebd-a264-4f54-98a7-c6c99feb40a5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:06.588241 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9fa21ebd-a264-4f54-98a7-c6c99feb40a5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:06.588993 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9fa21ebd-a264-4f54-98a7-c6c99feb40a5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:06.589481 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9fa21ebd-a264-4f54-98a7-c6c99feb40a5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:06.589904 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-9fa21ebd-a264-4f54-98a7-c6c99feb40a5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:06.720805 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-9fa21ebd-a264-4f54-98a7-c6c99feb40a5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:01:06.728553 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-9fa21ebd-a264-4f54-98a7-c6c99feb40a5 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 200 len: 1366 microversion: 2.1 time: 0.153013 Aug 29 22:01:06.729124 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 565/1123] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:01:06 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:01:07.577199 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [req-1903dff2-6ae7-4ac0-9375-6d51a7b6f93b req-b7412fbf-6486-4147-bf31-8003e0c48c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1312e41-9aae-4a30-a98e-2b164c5e4f7e", "name": "network-vif-plugged", "status": "completed", "tag": "3fae8113-afa2-4b2e-a389-c8e987d7744e"}]} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:01:07.588221 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-1903dff2-6ae7-4ac0-9375-6d51a7b6f93b req-b7412fbf-6486-4147-bf31-8003e0c48c08 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:07.588955 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-1903dff2-6ae7-4ac0-9375-6d51a7b6f93b req-b7412fbf-6486-4147-bf31-8003e0c48c08 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:07.589186 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [req-1903dff2-6ae7-4ac0-9375-6d51a7b6f93b req-b7412fbf-6486-4147-bf31-8003e0c48c08 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:07.601196 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.compute.server_external_events [req-1903dff2-6ae7-4ac0-9375-6d51a7b6f93b req-b7412fbf-6486-4147-bf31-8003e0c48c08 service nova] Creating event network-vif-plugged:3fae8113-afa2-4b2e-a389-c8e987d7744e for instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e on hv-cinder-85426 Aug 29 22:01:07.606288 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [req-1903dff2-6ae7-4ac0-9375-6d51a7b6f93b req-b7412fbf-6486-4147-bf31-8003e0c48c08 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032730 Aug 29 22:01:07.606869 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 559/1124] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 22:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:01:07.749406 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a151f433-cf24-47f3-bfea-b7f2ea73ed3c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:07.750087 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a151f433-cf24-47f3-bfea-b7f2ea73ed3c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:07.756950 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a151f433-cf24-47f3-bfea-b7f2ea73ed3c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:07.757441 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a151f433-cf24-47f3-bfea-b7f2ea73ed3c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:07.757884 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a151f433-cf24-47f3-bfea-b7f2ea73ed3c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:07.759117 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a151f433-cf24-47f3-bfea-b7f2ea73ed3c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:07.759574 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a151f433-cf24-47f3-bfea-b7f2ea73ed3c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:07.760003 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a151f433-cf24-47f3-bfea-b7f2ea73ed3c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:07.894733 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a151f433-cf24-47f3-bfea-b7f2ea73ed3c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:01:07.902473 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a151f433-cf24-47f3-bfea-b7f2ea73ed3c tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 200 len: 1366 microversion: 2.1 time: 0.157007 Aug 29 22:01:07.903070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 566/1125] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:01:07 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:01:08.920855 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:01:08.921543 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell0:SELECT=6 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:01:08.926280 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-bee28fde-a51b-4fa6-b580-5064f1da0044 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:08.927034 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-bee28fde-a51b-4fa6-b580-5064f1da0044 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:08.933544 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bee28fde-a51b-4fa6-b580-5064f1da0044 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:08.936568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bee28fde-a51b-4fa6-b580-5064f1da0044 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:08.936568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bee28fde-a51b-4fa6-b580-5064f1da0044 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:08.936568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bee28fde-a51b-4fa6-b580-5064f1da0044 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:08.936568 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bee28fde-a51b-4fa6-b580-5064f1da0044 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:08.936982 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bee28fde-a51b-4fa6-b580-5064f1da0044 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:09.073263 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-bee28fde-a51b-4fa6-b580-5064f1da0044 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:01:09.081364 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-bee28fde-a51b-4fa6-b580-5064f1da0044 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 200 len: 1366 microversion: 2.1 time: 0.161530 Aug 29 22:01:09.082597 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 560/1126] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:01:08 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:01:10.102210 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a05d27fc-c24c-4ce4-a738-c5dac6bc5f1a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:10.102798 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-a05d27fc-c24c-4ce4-a738-c5dac6bc5f1a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:10.104813 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell0:SELECT=6 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:01:10.110329 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a05d27fc-c24c-4ce4-a738-c5dac6bc5f1a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:10.110816 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a05d27fc-c24c-4ce4-a738-c5dac6bc5f1a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:10.115784 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a05d27fc-c24c-4ce4-a738-c5dac6bc5f1a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:10.115784 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a05d27fc-c24c-4ce4-a738-c5dac6bc5f1a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:10.115784 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a05d27fc-c24c-4ce4-a738-c5dac6bc5f1a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:10.115784 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-a05d27fc-c24c-4ce4-a738-c5dac6bc5f1a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:10.246966 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-a05d27fc-c24c-4ce4-a738-c5dac6bc5f1a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:01:10.254895 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a05d27fc-c24c-4ce4-a738-c5dac6bc5f1a tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 200 len: 1557 microversion: 2.1 time: 0.156541 Aug 29 22:01:10.255471 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 567/1127] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:01:10 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:01:10.275503 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8a67375b-abfe-40a4-bc39-aac3b5a9ecd4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:10.276036 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-8a67375b-abfe-40a4-bc39-aac3b5a9ecd4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:10.282350 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a67375b-abfe-40a4-bc39-aac3b5a9ecd4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:10.282832 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a67375b-abfe-40a4-bc39-aac3b5a9ecd4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:10.283264 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a67375b-abfe-40a4-bc39-aac3b5a9ecd4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:10.283954 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a67375b-abfe-40a4-bc39-aac3b5a9ecd4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:10.284403 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a67375b-abfe-40a4-bc39-aac3b5a9ecd4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:10.284850 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-8a67375b-abfe-40a4-bc39-aac3b5a9ecd4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:10.365227 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-8a67375b-abfe-40a4-bc39-aac3b5a9ecd4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093518 Aug 29 22:01:10.365880 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 561/1128] 10.222.0.83 () {58 vars in 1275 bytes} [Mon Aug 29 22:01:10 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:01:11.392114 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-c52b39f1-33ba-461b-80ba-53cedf4751ed req-ee4f4808-5eff-408c-a3e1-647b39de5684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1312e41-9aae-4a30-a98e-2b164c5e4f7e", "tag": "3fae8113-afa2-4b2e-a389-c8e987d7744e"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:01:11.402672 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-c52b39f1-33ba-461b-80ba-53cedf4751ed req-ee4f4808-5eff-408c-a3e1-647b39de5684 service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:11.403156 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-c52b39f1-33ba-461b-80ba-53cedf4751ed req-ee4f4808-5eff-408c-a3e1-647b39de5684 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:11.403870 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-c52b39f1-33ba-461b-80ba-53cedf4751ed req-ee4f4808-5eff-408c-a3e1-647b39de5684 service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:11.415070 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-c52b39f1-33ba-461b-80ba-53cedf4751ed req-ee4f4808-5eff-408c-a3e1-647b39de5684 service nova] Creating event network-changed:3fae8113-afa2-4b2e-a389-c8e987d7744e for instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e on hv-cinder-85426 Aug 29 22:01:11.420617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-c52b39f1-33ba-461b-80ba-53cedf4751ed req-ee4f4808-5eff-408c-a3e1-647b39de5684 service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032137 Aug 29 22:01:11.424027 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 568/1129] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 22:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:01:47.293651 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:01:47.294369 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG dbcounter [-] [127883] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:01:47.298432 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-19292f8f-5cfd-42ff-aaa6-3be3f67a54db tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:47.298915 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-19292f8f-5cfd-42ff-aaa6-3be3f67a54db tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:47.305057 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-19292f8f-5cfd-42ff-aaa6-3be3f67a54db tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:47.305534 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-19292f8f-5cfd-42ff-aaa6-3be3f67a54db tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:47.305968 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-19292f8f-5cfd-42ff-aaa6-3be3f67a54db tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:47.306907 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-19292f8f-5cfd-42ff-aaa6-3be3f67a54db tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:47.307357 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-19292f8f-5cfd-42ff-aaa6-3be3f67a54db tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:47.307778 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-19292f8f-5cfd-42ff-aaa6-3be3f67a54db tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:47.331409 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-19292f8f-5cfd-42ff-aaa6-3be3f67a54db tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e/ips" status: 200 len: 150 microversion: 2.1 time: 0.039783 Aug 29 22:01:47.331975 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 562/1130] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 22:01:47 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:01:48.897926 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 22:01:48.898569 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Mon Aug 29 22:01:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e/os-volume_attachments (ip 10.222.0.83) !!! Aug 29 22:01:48.900522 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:01:48.901248 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG dbcounter [-] [127882] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:01:48.905553 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-ba268706-dd2e-46da-b3d3-527d7504a295 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0719a1da-8580-4f01-b444-f522e4b99bbd"}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:01:48.911237 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-ba268706-dd2e-46da-b3d3-527d7504a295 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:48.918957 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba268706-dd2e-46da-b3d3-527d7504a295 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:48.919466 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba268706-dd2e-46da-b3d3-527d7504a295 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:48.919865 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba268706-dd2e-46da-b3d3-527d7504a295 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:48.920585 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba268706-dd2e-46da-b3d3-527d7504a295 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:48.921040 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba268706-dd2e-46da-b3d3-527d7504a295 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:48.921464 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-ba268706-dd2e-46da-b3d3-527d7504a295 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:50.010829 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-ba268706-dd2e-46da-b3d3-527d7504a295 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "POST /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.114044 Aug 29 22:01:50.013769 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 569/1131] 10.222.0.83 () {60 vars in 1323 bytes} [Mon Aug 29 22:01:48 2022] POST /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e/os-volume_attachments => generated 194 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:01:52.362804 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-44c334c4-03c0-4833-89c4-70e2b0753113 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:52.363388 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-44c334c4-03c0-4833-89c4-70e2b0753113 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:52.371425 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-44c334c4-03c0-4833-89c4-70e2b0753113 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:52.378789 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-44c334c4-03c0-4833-89c4-70e2b0753113 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:52.378789 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-44c334c4-03c0-4833-89c4-70e2b0753113 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:52.378789 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-44c334c4-03c0-4833-89c4-70e2b0753113 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:52.378789 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-44c334c4-03c0-4833-89c4-70e2b0753113 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:52.379227 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-44c334c4-03c0-4833-89c4-70e2b0753113 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:52.459070 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-44c334c4-03c0-4833-89c4-70e2b0753113 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lazy-loading 'services' on Instance uuid e1312e41-9aae-4a30-a98e-2b164c5e4f7e {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:01:52.684334 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-44c334c4-03c0-4833-89c4-70e2b0753113 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "DELETE /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e/os-volume_attachments/0719a1da-8580-4f01-b444-f522e4b99bbd" status: 202 len: 0 microversion: 2.1 time: 0.325348 Aug 29 22:01:52.685119 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 563/1132] 10.222.0.83 () {58 vars in 1416 bytes} [Mon Aug 29 22:01:52 2022] DELETE /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e/os-volume_attachments/0719a1da-8580-4f01-b444-f522e4b99bbd => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:01:52.696662 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-807cd4f4-4861-4850-a27e-dc6bcc2c6d67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:52.699075 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-807cd4f4-4861-4850-a27e-dc6bcc2c6d67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:52.705862 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-807cd4f4-4861-4850-a27e-dc6bcc2c6d67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:52.706347 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-807cd4f4-4861-4850-a27e-dc6bcc2c6d67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:52.714397 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-807cd4f4-4861-4850-a27e-dc6bcc2c6d67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:52.714397 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-807cd4f4-4861-4850-a27e-dc6bcc2c6d67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:52.714397 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-807cd4f4-4861-4850-a27e-dc6bcc2c6d67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:52.714397 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-807cd4f4-4861-4850-a27e-dc6bcc2c6d67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:52.748460 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-807cd4f4-4861-4850-a27e-dc6bcc2c6d67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057867 Aug 29 22:01:52.749065 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 570/1133] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 22:01:52 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:01:53.762367 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a499aabb-003f-4360-b992-c4b5563acc84 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:53.768677 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a499aabb-003f-4360-b992-c4b5563acc84 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:53.771513 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a499aabb-003f-4360-b992-c4b5563acc84 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:53.772011 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a499aabb-003f-4360-b992-c4b5563acc84 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:53.772453 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a499aabb-003f-4360-b992-c4b5563acc84 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:53.773267 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a499aabb-003f-4360-b992-c4b5563acc84 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:53.774254 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a499aabb-003f-4360-b992-c4b5563acc84 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:53.774691 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a499aabb-003f-4360-b992-c4b5563acc84 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:53.806129 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a499aabb-003f-4360-b992-c4b5563acc84 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048637 Aug 29 22:01:53.807024 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 564/1134] 10.222.0.83 () {58 vars in 1302 bytes} [Mon Aug 29 22:01:53 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 22:01:53.870574 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-3a288013-327f-465a-9568-881bf217c033 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:53.871205 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3a288013-327f-465a-9568-881bf217c033 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:53.877868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a288013-327f-465a-9568-881bf217c033 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:53.878363 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a288013-327f-465a-9568-881bf217c033 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:53.878810 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a288013-327f-465a-9568-881bf217c033 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:53.879511 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a288013-327f-465a-9568-881bf217c033 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:53.880115 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a288013-327f-465a-9568-881bf217c033 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:53.880573 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-3a288013-327f-465a-9568-881bf217c033 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:53.906824 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-3a288013-327f-465a-9568-881bf217c033 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Going to try to terminate instance {{(pid=127882) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:01:54.284220 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-3a288013-327f-465a-9568-881bf217c033 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "DELETE /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 204 len: 0 microversion: 2.1 time: 0.417209 Aug 29 22:01:54.285074 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 571/1135] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 22:01:53 2022] DELETE /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:01:54.294782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-bbacec61-7a14-4413-89a5-1dadf85e9176 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:54.300748 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-bbacec61-7a14-4413-89a5-1dadf85e9176 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:54.302721 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bbacec61-7a14-4413-89a5-1dadf85e9176 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:54.303210 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bbacec61-7a14-4413-89a5-1dadf85e9176 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:54.303650 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bbacec61-7a14-4413-89a5-1dadf85e9176 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:54.304352 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bbacec61-7a14-4413-89a5-1dadf85e9176 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:54.304859 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bbacec61-7a14-4413-89a5-1dadf85e9176 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:54.305278 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-bbacec61-7a14-4413-89a5-1dadf85e9176 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:54.444507 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-bbacec61-7a14-4413-89a5-1dadf85e9176 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:01:54.453021 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-bbacec61-7a14-4413-89a5-1dadf85e9176 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 200 len: 1681 microversion: 2.1 time: 0.162963 Aug 29 22:01:54.453598 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 565/1136] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:01:54 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:01:55.475617 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-42396e0e-b93c-4a89-8823-2a37fb56d76b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:55.476397 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-42396e0e-b93c-4a89-8823-2a37fb56d76b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:55.484013 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-42396e0e-b93c-4a89-8823-2a37fb56d76b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:55.484540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-42396e0e-b93c-4a89-8823-2a37fb56d76b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:55.484987 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-42396e0e-b93c-4a89-8823-2a37fb56d76b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:55.485866 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-42396e0e-b93c-4a89-8823-2a37fb56d76b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:55.486330 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-42396e0e-b93c-4a89-8823-2a37fb56d76b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:55.486762 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-42396e0e-b93c-4a89-8823-2a37fb56d76b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:55.631256 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.policy [None req-42396e0e-b93c-4a89-8823-2a37fb56d76b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127882) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:01:55.640006 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-42396e0e-b93c-4a89-8823-2a37fb56d76b tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 200 len: 1681 microversion: 2.1 time: 0.168737 Aug 29 22:01:55.640616 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 572/1137] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:01:55 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:01:56.663702 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-227689a1-8928-4c6b-b9ee-afcb7d3143a3 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:56.664977 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-227689a1-8928-4c6b-b9ee-afcb7d3143a3 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:56.670947 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-227689a1-8928-4c6b-b9ee-afcb7d3143a3 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:56.671428 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-227689a1-8928-4c6b-b9ee-afcb7d3143a3 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:56.671868 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-227689a1-8928-4c6b-b9ee-afcb7d3143a3 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:56.672580 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-227689a1-8928-4c6b-b9ee-afcb7d3143a3 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:56.673114 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-227689a1-8928-4c6b-b9ee-afcb7d3143a3 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:56.673686 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-227689a1-8928-4c6b-b9ee-afcb7d3143a3 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:56.839917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-227689a1-8928-4c6b-b9ee-afcb7d3143a3 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:01:56.847848 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-227689a1-8928-4c6b-b9ee-afcb7d3143a3 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 200 len: 1681 microversion: 2.1 time: 0.188349 Aug 29 22:01:56.849737 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 566/1138] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:01:56 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:01:57.271302 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [req-8f02bd0c-fcd8-42e6-bc34-dd8a3495c0fc req-d31bdc91-369d-46c4-b2e0-5d1fe03ee43b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1312e41-9aae-4a30-a98e-2b164c5e4f7e", "name": "network-vif-deleted", "tag": "3fae8113-afa2-4b2e-a389-c8e987d7744e"}]} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:01:57.282309 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-8f02bd0c-fcd8-42e6-bc34-dd8a3495c0fc req-d31bdc91-369d-46c4-b2e0-5d1fe03ee43b service nova] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:57.282791 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-8f02bd0c-fcd8-42e6-bc34-dd8a3495c0fc req-d31bdc91-369d-46c4-b2e0-5d1fe03ee43b service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:57.283435 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [req-8f02bd0c-fcd8-42e6-bc34-dd8a3495c0fc req-d31bdc91-369d-46c4-b2e0-5d1fe03ee43b service nova] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:57.296535 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.compute.server_external_events [req-8f02bd0c-fcd8-42e6-bc34-dd8a3495c0fc req-d31bdc91-369d-46c4-b2e0-5d1fe03ee43b service nova] Creating event network-vif-deleted:3fae8113-afa2-4b2e-a389-c8e987d7744e for instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e on hv-cinder-85426 Aug 29 22:01:57.302138 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [req-8f02bd0c-fcd8-42e6-bc34-dd8a3495c0fc req-d31bdc91-369d-46c4-b2e0-5d1fe03ee43b service nova] 10.222.0.83 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103385 Aug 29 22:01:57.302761 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 573/1139] 10.222.0.83 () {64 vars in 1317 bytes} [Mon Aug 29 22:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:01:57.871058 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-092743eb-5a0f-48da-9309-a7667b507c45 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:57.871863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-092743eb-5a0f-48da-9309-a7667b507c45 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:57.879074 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-092743eb-5a0f-48da-9309-a7667b507c45 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:57.879576 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-092743eb-5a0f-48da-9309-a7667b507c45 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:57.880019 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-092743eb-5a0f-48da-9309-a7667b507c45 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:57.880798 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-092743eb-5a0f-48da-9309-a7667b507c45 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:57.881267 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-092743eb-5a0f-48da-9309-a7667b507c45 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:57.881717 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-092743eb-5a0f-48da-9309-a7667b507c45 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:57.921440 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-092743eb-5a0f-48da-9309-a7667b507c45 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:57.921929 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-092743eb-5a0f-48da-9309-a7667b507c45 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:57.922376 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-092743eb-5a0f-48da-9309-a7667b507c45 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:57.922839 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.objects.instance [None req-092743eb-5a0f-48da-9309-a7667b507c45 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lazy-loading 'fault' on Instance uuid e1312e41-9aae-4a30-a98e-2b164c5e4f7e {{(pid=127883) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:01:57.967366 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.policy [None req-092743eb-5a0f-48da-9309-a7667b507c45 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a878450743f4843a5e8cc04ca94184d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926837c28a3743deab8a4849571ecd19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127883) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:01:57.975370 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-092743eb-5a0f-48da-9309-a7667b507c45 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 200 len: 1331 microversion: 2.1 time: 0.109026 Aug 29 22:01:57.975943 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 567/1140] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:01:57 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:01:59.000476 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0206a59c-b5d6-4fcb-ac4e-81b92d6e07fd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:59.001266 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-0206a59c-b5d6-4fcb-ac4e-81b92d6e07fd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:01:59.007855 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0206a59c-b5d6-4fcb-ac4e-81b92d6e07fd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:59.008908 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0206a59c-b5d6-4fcb-ac4e-81b92d6e07fd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:59.009362 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0206a59c-b5d6-4fcb-ac4e-81b92d6e07fd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:59.010071 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0206a59c-b5d6-4fcb-ac4e-81b92d6e07fd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:01:59.010531 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0206a59c-b5d6-4fcb-ac4e-81b92d6e07fd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:01:59.010960 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-0206a59c-b5d6-4fcb-ac4e-81b92d6e07fd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:01:59.025051 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-0206a59c-b5d6-4fcb-ac4e-81b92d6e07fd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] HTTP exception thrown: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0206a59c-b5d6-4fcb-ac4e-81b92d6e07fd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Request method failure captured: Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e HTTP/1.1 Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTZLVEObYhy0XvUUBWReeF5_kugi_bGrw2NNDFt07_UsV3pUzA3h3sIgkCsJDb8h6RjVLqb8H4JpVV6TDe-f8caIDdu7ab4GDnUrNqI-5GJXbQUYIEbL-eXnbUDWZ_kWZwPzrCKTL6HNsAkc49EWegEnggwEm8jJ-obMU_4_tuUcdeo Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 22:01:59.026773 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 22:01:59.028565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_926837c28a3743deab8a4849571ecd19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/926837c28a3743deab8a4849571ecd19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:01:59.028565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:01:59.028565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:01:59.028565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:01:59.028565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:01:59.028565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 22:01:59.028565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 22:01:59.028565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 3a878450743f4843a5e8cc04ca94184d Aug 29 22:01:59.028565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:01:59.028565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 22:01:59.028565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. Aug 29 22:01:59.028565 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': 'e1312e41-9aae-4a30-a98e-2b164c5e4f7e'} Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:01:59.029543 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. Aug 29 22:01:59.031196 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:01:59.032637 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-0206a59c-b5d6-4fcb-ac4e-81b92d6e07fd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Returning 404 to user: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:01:59.032637 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-0206a59c-b5d6-4fcb-ac4e-81b92d6e07fd tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 404 len: 111 microversion: 2.1 time: 0.032670 Aug 29 22:01:59.032637 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 574/1141] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:01:58 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:01:59.037150 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-286332f4-6e44-41ce-8643-6eeb9edd61f4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '.version_select at 0x7f50408971f0>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:01:59.120672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-286332f4-6e44-41ce-8643-6eeb9edd61f4 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-726093561" status: 202 len: 0 microversion: 2.1 time: 0.087198 Aug 29 22:01:59.121295 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 568/1142] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 22:01:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-726093561 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:02:01.327968 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-09c78ee1-69e8-4339-ae13-6ce3b4975850 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:02:01.328659 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-09c78ee1-69e8-4339-ae13-6ce3b4975850 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:02:01.335667 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09c78ee1-69e8-4339-ae13-6ce3b4975850 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:01.336702 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09c78ee1-69e8-4339-ae13-6ce3b4975850 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:01.337151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09c78ee1-69e8-4339-ae13-6ce3b4975850 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:01.337890 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09c78ee1-69e8-4339-ae13-6ce3b4975850 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:01.338350 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09c78ee1-69e8-4339-ae13-6ce3b4975850 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:01.338784 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-09c78ee1-69e8-4339-ae13-6ce3b4975850 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:01.357360 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-09c78ee1-69e8-4339-ae13-6ce3b4975850 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] HTTP exception thrown: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-09c78ee1-69e8-4339-ae13-6ce3b4975850 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Request method failure captured: Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: DELETE /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e HTTP/1.1 Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTZLVEObYhy0XvUUBWReeF5_kugi_bGrw2NNDFt07_UsV3pUzA3h3sIgkCsJDb8h6RjVLqb8H4JpVV6TDe-f8caIDdu7ab4GDnUrNqI-5GJXbQUYIEbL-eXnbUDWZ_kWZwPzrCKTL6HNsAkc49EWegEnggwEm8jJ-obMU_4_tuUcdeo Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 22:02:01.358977 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 22:02:01.360602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_926837c28a3743deab8a4849571ecd19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/926837c28a3743deab8a4849571ecd19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:02:01.360602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:01.360602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:01.360602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:01.360602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:01.360602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 22:02:01.360602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 22:02:01.360602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 3a878450743f4843a5e8cc04ca94184d Aug 29 22:02:01.360602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:01.360602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 22:02:01.360602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. Aug 29 22:02:01.360602 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': 'e1312e41-9aae-4a30-a98e-2b164c5e4f7e'} Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:02:01.361438 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. Aug 29 22:02:01.362772 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:01.364076 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-09c78ee1-69e8-4339-ae13-6ce3b4975850 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Returning 404 to user: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:02:01.364076 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-09c78ee1-69e8-4339-ae13-6ce3b4975850 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "DELETE /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 404 len: 111 microversion: 2.1 time: 0.036609 Aug 29 22:02:01.364076 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 575/1143] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 22:02:01 2022] DELETE /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:02:01.370508 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-92e1c9ef-a273-4359-a3da-abf8431bdd71 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:02:01.371113 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-92e1c9ef-a273-4359-a3da-abf8431bdd71 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: e1312e41-9aae-4a30-a98e-2b164c5e4f7e] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:02:01.378242 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92e1c9ef-a273-4359-a3da-abf8431bdd71 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:01.378739 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92e1c9ef-a273-4359-a3da-abf8431bdd71 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:01.379176 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92e1c9ef-a273-4359-a3da-abf8431bdd71 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:01.379914 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92e1c9ef-a273-4359-a3da-abf8431bdd71 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:01.380377 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92e1c9ef-a273-4359-a3da-abf8431bdd71 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:01.380837 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-92e1c9ef-a273-4359-a3da-abf8431bdd71 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:01.396194 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-92e1c9ef-a273-4359-a3da-abf8431bdd71 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] HTTP exception thrown: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-92e1c9ef-a273-4359-a3da-abf8431bdd71 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Request method failure captured: Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e HTTP/1.1 Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTZLVEObYhy0XvUUBWReeF5_kugi_bGrw2NNDFt07_UsV3pUzA3h3sIgkCsJDb8h6RjVLqb8H4JpVV6TDe-f8caIDdu7ab4GDnUrNqI-5GJXbQUYIEbL-eXnbUDWZ_kWZwPzrCKTL6HNsAkc49EWegEnggwEm8jJ-obMU_4_tuUcdeo Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 22:02:01.397903 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 22:02:01.400268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_926837c28a3743deab8a4849571ecd19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/926837c28a3743deab8a4849571ecd19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:02:01.400268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:01.400268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:01.400268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:01.400268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:01.400268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 22:02:01.400268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 22:02:01.400268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 3a878450743f4843a5e8cc04ca94184d Aug 29 22:02:01.400268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:01.400268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 22:02:01.400268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. Aug 29 22:02:01.400268 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': 'e1312e41-9aae-4a30-a98e-2b164c5e4f7e'} Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:02:01.409799 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. Aug 29 22:02:01.412782 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:01.415612 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-92e1c9ef-a273-4359-a3da-abf8431bdd71 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Returning 404 to user: Instance e1312e41-9aae-4a30-a98e-2b164c5e4f7e could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:02:01.415612 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-92e1c9ef-a273-4359-a3da-abf8431bdd71 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e" status: 404 len: 111 microversion: 2.1 time: 0.033786 Aug 29 22:02:01.415612 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 569/1144] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:02:01 2022] GET /compute/v2.1/servers/e1312e41-9aae-4a30-a98e-2b164c5e4f7e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:02:02.723819 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d93a80ac-53f4-4bb9-9de6-b5058b24f199 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:02:02.724301 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-d93a80ac-53f4-4bb9-9de6-b5058b24f199 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:02:02.730807 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d93a80ac-53f4-4bb9-9de6-b5058b24f199 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:02.731286 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d93a80ac-53f4-4bb9-9de6-b5058b24f199 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:02.731722 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d93a80ac-53f4-4bb9-9de6-b5058b24f199 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:02.732522 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d93a80ac-53f4-4bb9-9de6-b5058b24f199 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:02.732972 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d93a80ac-53f4-4bb9-9de6-b5058b24f199 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:02.733398 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-d93a80ac-53f4-4bb9-9de6-b5058b24f199 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:02.747538 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-d93a80ac-53f4-4bb9-9de6-b5058b24f199 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] HTTP exception thrown: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d93a80ac-53f4-4bb9-9de6-b5058b24f199 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Request method failure captured: Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: DELETE /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b HTTP/1.1 Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTZLVEObYhy0XvUUBWReeF5_kugi_bGrw2NNDFt07_UsV3pUzA3h3sIgkCsJDb8h6RjVLqb8H4JpVV6TDe-f8caIDdu7ab4GDnUrNqI-5GJXbQUYIEbL-eXnbUDWZ_kWZwPzrCKTL6HNsAkc49EWegEnggwEm8jJ-obMU_4_tuUcdeo Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 22:02:02.749149 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 22:02:02.750868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_926837c28a3743deab8a4849571ecd19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/926837c28a3743deab8a4849571ecd19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:02:02.750868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:02.750868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:02.750868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:02.750868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:02.750868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 22:02:02.750868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 22:02:02.750868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 3a878450743f4843a5e8cc04ca94184d Aug 29 22:02:02.750868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:02.750868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 22:02:02.750868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. Aug 29 22:02:02.750868 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '4922b97b-c90d-4573-985b-1670a879795b'} Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:02:02.751857 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. Aug 29 22:02:02.753610 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.755284 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-d93a80ac-53f4-4bb9-9de6-b5058b24f199 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Returning 404 to user: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:02:02.755284 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-d93a80ac-53f4-4bb9-9de6-b5058b24f199 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "DELETE /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 404 len: 111 microversion: 2.1 time: 0.030495 Aug 29 22:02:02.755284 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 576/1145] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 22:02:02 2022] DELETE /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:02:02.759665 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-39e32eb0-aef2-4dc1-ba65-00281155b986 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:02:02.760285 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-39e32eb0-aef2-4dc1-ba65-00281155b986 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 4922b97b-c90d-4573-985b-1670a879795b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:02:02.766977 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-39e32eb0-aef2-4dc1-ba65-00281155b986 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:02.767470 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-39e32eb0-aef2-4dc1-ba65-00281155b986 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:02.767911 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-39e32eb0-aef2-4dc1-ba65-00281155b986 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:02.768678 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-39e32eb0-aef2-4dc1-ba65-00281155b986 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:02.769145 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-39e32eb0-aef2-4dc1-ba65-00281155b986 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:02.769582 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-39e32eb0-aef2-4dc1-ba65-00281155b986 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:02.783478 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-39e32eb0-aef2-4dc1-ba65-00281155b986 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] HTTP exception thrown: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-39e32eb0-aef2-4dc1-ba65-00281155b986 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Request method failure captured: Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b HTTP/1.1 Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTZLVEObYhy0XvUUBWReeF5_kugi_bGrw2NNDFt07_UsV3pUzA3h3sIgkCsJDb8h6RjVLqb8H4JpVV6TDe-f8caIDdu7ab4GDnUrNqI-5GJXbQUYIEbL-eXnbUDWZ_kWZwPzrCKTL6HNsAkc49EWegEnggwEm8jJ-obMU_4_tuUcdeo Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 22:02:02.785035 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 22:02:02.786769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_926837c28a3743deab8a4849571ecd19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/926837c28a3743deab8a4849571ecd19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:02:02.786769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:02.786769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:02.786769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:02.786769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:02.786769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 22:02:02.786769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 22:02:02.786769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 3a878450743f4843a5e8cc04ca94184d Aug 29 22:02:02.786769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:02.786769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 22:02:02.786769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. Aug 29 22:02:02.786769 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': '4922b97b-c90d-4573-985b-1670a879795b'} Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:02:02.787706 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. Aug 29 22:02:02.789415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.790884 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-39e32eb0-aef2-4dc1-ba65-00281155b986 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Returning 404 to user: Instance 4922b97b-c90d-4573-985b-1670a879795b could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:02:02.790884 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-39e32eb0-aef2-4dc1-ba65-00281155b986 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b" status: 404 len: 111 microversion: 2.1 time: 0.031225 Aug 29 22:02:02.790884 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 570/1146] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:02:02 2022] GET /compute/v2.1/servers/4922b97b-c90d-4573-985b-1670a879795b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:02:02.795171 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-db6f0c0d-f790-4e3a-8001-654b6b9c3c44 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:02:02.795667 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-db6f0c0d-f790-4e3a-8001-654b6b9c3c44 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:02:02.801898 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db6f0c0d-f790-4e3a-8001-654b6b9c3c44 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:02.802373 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db6f0c0d-f790-4e3a-8001-654b6b9c3c44 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:02.802809 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db6f0c0d-f790-4e3a-8001-654b6b9c3c44 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:02.803494 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db6f0c0d-f790-4e3a-8001-654b6b9c3c44 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:02.803938 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db6f0c0d-f790-4e3a-8001-654b6b9c3c44 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:02.804540 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-db6f0c0d-f790-4e3a-8001-654b6b9c3c44 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:02.818482 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-db6f0c0d-f790-4e3a-8001-654b6b9c3c44 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] HTTP exception thrown: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-db6f0c0d-f790-4e3a-8001-654b6b9c3c44 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Request method failure captured: Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: DELETE /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 HTTP/1.1 Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTZLVEObYhy0XvUUBWReeF5_kugi_bGrw2NNDFt07_UsV3pUzA3h3sIgkCsJDb8h6RjVLqb8H4JpVV6TDe-f8caIDdu7ab4GDnUrNqI-5GJXbQUYIEbL-eXnbUDWZ_kWZwPzrCKTL6HNsAkc49EWegEnggwEm8jJ-obMU_4_tuUcdeo Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 22:02:02.820038 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 22:02:02.822520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_926837c28a3743deab8a4849571ecd19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/926837c28a3743deab8a4849571ecd19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:02:02.822520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:02.822520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:02.822520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:02.822520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:02.822520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 22:02:02.822520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 22:02:02.822520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 3a878450743f4843a5e8cc04ca94184d Aug 29 22:02:02.822520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:02.822520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 22:02:02.822520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. Aug 29 22:02:02.822520 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': 'b9af2023-7f55-4a86-b266-b2c6e8ec7878'} Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:02:02.823611 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. Aug 29 22:02:02.825252 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.826902 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-db6f0c0d-f790-4e3a-8001-654b6b9c3c44 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Returning 404 to user: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:02:02.826902 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-db6f0c0d-f790-4e3a-8001-654b6b9c3c44 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "DELETE /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 404 len: 111 microversion: 2.1 time: 0.030867 Aug 29 22:02:02.826902 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 577/1147] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 22:02:02 2022] DELETE /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:02:02.831251 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a21cf5a6-d5f8-42fd-b017-1e4acc37be67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:02:02.831864 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-a21cf5a6-d5f8-42fd-b017-1e4acc37be67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: b9af2023-7f55-4a86-b266-b2c6e8ec7878] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:02:02.838180 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a21cf5a6-d5f8-42fd-b017-1e4acc37be67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:02.838723 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a21cf5a6-d5f8-42fd-b017-1e4acc37be67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:02.839213 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a21cf5a6-d5f8-42fd-b017-1e4acc37be67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:02.840017 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a21cf5a6-d5f8-42fd-b017-1e4acc37be67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:02.840475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a21cf5a6-d5f8-42fd-b017-1e4acc37be67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:02.840990 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-a21cf5a6-d5f8-42fd-b017-1e4acc37be67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:02.854626 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-a21cf5a6-d5f8-42fd-b017-1e4acc37be67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] HTTP exception thrown: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a21cf5a6-d5f8-42fd-b017-1e4acc37be67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Request method failure captured: Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 HTTP/1.1 Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTZLVEObYhy0XvUUBWReeF5_kugi_bGrw2NNDFt07_UsV3pUzA3h3sIgkCsJDb8h6RjVLqb8H4JpVV6TDe-f8caIDdu7ab4GDnUrNqI-5GJXbQUYIEbL-eXnbUDWZ_kWZwPzrCKTL6HNsAkc49EWegEnggwEm8jJ-obMU_4_tuUcdeo Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 22:02:02.856175 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 22:02:02.857924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_926837c28a3743deab8a4849571ecd19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/926837c28a3743deab8a4849571ecd19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:02:02.857924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:02.857924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:02.857924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:02.857924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:02.857924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 22:02:02.857924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 22:02:02.857924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 3a878450743f4843a5e8cc04ca94184d Aug 29 22:02:02.857924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:02.857924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 22:02:02.857924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. Aug 29 22:02:02.857924 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': 'b9af2023-7f55-4a86-b266-b2c6e8ec7878'} Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:02:02.858863 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. Aug 29 22:02:02.860532 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:02.862063 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-a21cf5a6-d5f8-42fd-b017-1e4acc37be67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Returning 404 to user: Instance b9af2023-7f55-4a86-b266-b2c6e8ec7878 could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:02:02.862063 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-a21cf5a6-d5f8-42fd-b017-1e4acc37be67 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878" status: 404 len: 111 microversion: 2.1 time: 0.030159 Aug 29 22:02:02.862063 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 571/1148] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:02:02 2022] GET /compute/v2.1/servers/b9af2023-7f55-4a86-b266-b2c6e8ec7878 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:02:04.178168 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c29a1667-186d-467a-8afa-f2c6b94916f0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:02:04.178842 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.compute.api [None req-c29a1667-186d-467a-8afa-f2c6b94916f0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127882) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:02:04.187004 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c29a1667-186d-467a-8afa-f2c6b94916f0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:04.187486 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c29a1667-186d-467a-8afa-f2c6b94916f0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:04.187924 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c29a1667-186d-467a-8afa-f2c6b94916f0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:04.188697 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c29a1667-186d-467a-8afa-f2c6b94916f0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:04.189147 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c29a1667-186d-467a-8afa-f2c6b94916f0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:04.189568 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG oslo_concurrency.lockutils [None req-c29a1667-186d-467a-8afa-f2c6b94916f0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127882) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:04.207580 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-c29a1667-186d-467a-8afa-f2c6b94916f0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] HTTP exception thrown: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c29a1667-186d-467a-8afa-f2c6b94916f0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Request method failure captured: Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: DELETE /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b HTTP/1.1 Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTZLVEObYhy0XvUUBWReeF5_kugi_bGrw2NNDFt07_UsV3pUzA3h3sIgkCsJDb8h6RjVLqb8H4JpVV6TDe-f8caIDdu7ab4GDnUrNqI-5GJXbQUYIEbL-eXnbUDWZ_kWZwPzrCKTL6HNsAkc49EWegEnggwEm8jJ-obMU_4_tuUcdeo Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 22:02:04.209186 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 22:02:04.210929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_926837c28a3743deab8a4849571ecd19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/926837c28a3743deab8a4849571ecd19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:02:04.210929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:04.210929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:04.210929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:04.210929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:04.210929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 22:02:04.210929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 22:02:04.210929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 3a878450743f4843a5e8cc04ca94184d Aug 29 22:02:04.210929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:04.210929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: > Aug 29 22:02:04.210929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. Aug 29 22:02:04.210929 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': '45e3043f-0e5d-4928-9291-6b86323fa54b'} Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:02:04.211979 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. Aug 29 22:02:04.213586 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:04.215301 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c29a1667-186d-467a-8afa-f2c6b94916f0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Returning 404 to user: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:02:04.215301 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c29a1667-186d-467a-8afa-f2c6b94916f0 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "DELETE /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 404 len: 111 microversion: 2.1 time: 0.036274 Aug 29 22:02:04.215301 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 578/1149] 10.222.0.83 () {58 vars in 1239 bytes} [Mon Aug 29 22:02:04 2022] DELETE /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:02:04.219831 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7c281368-2b5d-47e2-bd74-fef9a233ef76 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Calling method '>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:02:04.220498 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.compute.api [None req-7c281368-2b5d-47e2-bd74-fef9a233ef76 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] [instance: 45e3043f-0e5d-4928-9291-6b86323fa54b] Fetching instance by UUID {{(pid=127883) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:02:04.227302 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7c281368-2b5d-47e2-bd74-fef9a233ef76 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:04.227907 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7c281368-2b5d-47e2-bd74-fef9a233ef76 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:04.228345 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7c281368-2b5d-47e2-bd74-fef9a233ef76 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:04.229153 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7c281368-2b5d-47e2-bd74-fef9a233ef76 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Acquiring lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:02:04.229674 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7c281368-2b5d-47e2-bd74-fef9a233ef76 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:02:04.230111 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG oslo_concurrency.lockutils [None req-7c281368-2b5d-47e2-bd74-fef9a233ef76 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Lock "f4124b42-2c45-4eaf-83bf-04e147b24cbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127883) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:02:04.245415 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-7c281368-2b5d-47e2-bd74-fef9a233ef76 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] HTTP exception thrown: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7c281368-2b5d-47e2-bd74-fef9a233ef76 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Request method failure captured: Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b HTTP/1.1 Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTZLVEObYhy0XvUUBWReeF5_kugi_bGrw2NNDFt07_UsV3pUzA3h3sIgkCsJDb8h6RjVLqb8H4JpVV6TDe-f8caIDdu7ab4GDnUrNqI-5GJXbQUYIEbL-eXnbUDWZ_kWZwPzrCKTL6HNsAkc49EWegEnggwEm8jJ-obMU_4_tuUcdeo Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 22:02:04.246959 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 22:02:04.249458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_926837c28a3743deab8a4849571ecd19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/926837c28a3743deab8a4849571ecd19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/926837c28a3743deab8a4849571ecd19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:02:04.249458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:04.249458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: 926837c28a3743deab8a4849571ecd19 Aug 29 22:02:04.249458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-671996841 Aug 29 22:02:04.249458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:04.249458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 22:02:04.249458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 22:02:04.249458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 3a878450743f4843a5e8cc04ca94184d Aug 29 22:02:04.249458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-AttachVolumeNegativeTest-671996841-project Aug 29 22:02:04.249458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: > Aug 29 22:02:04.249458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. Aug 29 22:02:04.249458 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': '45e3043f-0e5d-4928-9291-6b86323fa54b'} Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:02:04.250697 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. Aug 29 22:02:04.252533 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:04.254006 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-7c281368-2b5d-47e2-bd74-fef9a233ef76 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] Returning 404 to user: Instance 45e3043f-0e5d-4928-9291-6b86323fa54b could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:02:04.254006 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-7c281368-2b5d-47e2-bd74-fef9a233ef76 tempest-AttachVolumeNegativeTest-671996841 tempest-AttachVolumeNegativeTest-671996841-project] 10.222.0.83 "GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b" status: 404 len: 111 microversion: 2.1 time: 0.032711 Aug 29 22:02:04.254006 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 572/1150] 10.222.0.83 () {58 vars in 1236 bytes} [Mon Aug 29 22:02:04 2022] GET /compute/v2.1/servers/45e3043f-0e5d-4928-9291-6b86323fa54b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:02:10.018915 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6b561efd-58ef-4ca1-a467-e9d084c850c0 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Action: 'create', calling method: .version_select at 0x7f50406c05e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-277515526", "metadata": {"Type": "work"}}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6b561efd-58ef-4ca1-a467-e9d084c850c0 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Request method failure captured: Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 121 Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTdhtlYCH8BWOdzasajnCss7MInxOWgEnOnEuW6Q2-6jDaXCWWdoHfftc-wvbx5damehkdqE8GxihgdgOTDwo7WDBAeRSArJMln2QghG8jNm1WTwe66DSdeKvLl4aSky4PufjlsBukSxPfddO0b8e9knK88e6BiL4NqT6vThtXmUGtw Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: fd2aa669094b46b98206493668c99895 Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 22:02:10.035860 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 22:02:10.038203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fd2aa669094b46b98206493668c99895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fd2aa669094b46b98206493668c99895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fd2aa669094b46b98206493668c99895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fd2aa669094b46b98206493668c99895"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:02:10.038203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.038203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: fd2aa669094b46b98206493668c99895 Aug 29 22:02:10.038203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.038203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-VolumesNegativeTest-261854158-project Aug 29 22:02:10.038203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 22:02:10.038203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 22:02:10.038203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 0d3eb13e12cc466cac39ab025fe760b3 Aug 29 22:02:10.038203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-VolumesNegativeTest-261854158-project Aug 29 22:02:10.038203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Aug 29 22:02:10.038203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-277515526", "metadata": {"Type": "work"}}} Aug 29 22:02:10.038203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: Aug 29 22:02:10.038203 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-277515526', 'metadata': {'Type': 'work'}}}} Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise error Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:02:10.039477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 22:02:10.041597 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 22:02:10.043234 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 22:02:10.043234 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.043234 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-6b561efd-58ef-4ca1-a467-e9d084c850c0 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:02:10.043234 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-6b561efd-58ef-4ca1-a467-e9d084c850c0 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.135430 Aug 29 22:02:10.043234 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 579/1151] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 22:02:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:02:10.047055 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8f8589d5-cf42-4dff-919a-a1afba5cfa89 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Action: 'create', calling method: .version_select at 0x7f5040503820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1633306269", "metadata": {"Type": "work"}}} {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8f8589d5-cf42-4dff-919a-a1afba5cfa89 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Request method failure captured: Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 120 Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTdhtlYCH8BWOdzasajnCss7MInxOWgEnOnEuW6Q2-6jDaXCWWdoHfftc-wvbx5damehkdqE8GxihgdgOTDwo7WDBAeRSArJMln2QghG8jNm1WTwe66DSdeKvLl4aSky4PufjlsBukSxPfddO0b8e9knK88e6BiL4NqT6vThtXmUGtw Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: fd2aa669094b46b98206493668c99895 Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 22:02:10.051917 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 22:02:10.053689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fd2aa669094b46b98206493668c99895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fd2aa669094b46b98206493668c99895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fd2aa669094b46b98206493668c99895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fd2aa669094b46b98206493668c99895"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:02:10.053689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.053689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: fd2aa669094b46b98206493668c99895 Aug 29 22:02:10.053689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.053689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-VolumesNegativeTest-261854158-project Aug 29 22:02:10.053689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 22:02:10.053689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 22:02:10.053689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 0d3eb13e12cc466cac39ab025fe760b3 Aug 29 22:02:10.053689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-VolumesNegativeTest-261854158-project Aug 29 22:02:10.053689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Aug 29 22:02:10.053689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1633306269", "metadata": {"Type": "work"}}} Aug 29 22:02:10.053689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: Aug 29 22:02:10.053689 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1633306269', 'metadata': {'Type': 'work'}}}} Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise error Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi '0' Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:02:10.054909 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 22:02:10.056647 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 22:02:10.058319 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 22:02:10.058319 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.058319 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-8f8589d5-cf42-4dff-919a-a1afba5cfa89 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:02:10.058319 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-8f8589d5-cf42-4dff-919a-a1afba5cfa89 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010319 Aug 29 22:02:10.058319 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 573/1152] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 22:02:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:02:10.064302 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a9fd1e4c-3c84-4fad-a0b7-ccc784a067a8 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Action: 'create', calling method: .version_select at 0x7f50405dcca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1279571688", "metadata": {"Type": "work"}}} {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a9fd1e4c-3c84-4fad-a0b7-ccc784a067a8 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Request method failure captured: Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 119 Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTdhtlYCH8BWOdzasajnCss7MInxOWgEnOnEuW6Q2-6jDaXCWWdoHfftc-wvbx5damehkdqE8GxihgdgOTDwo7WDBAeRSArJMln2QghG8jNm1WTwe66DSdeKvLl4aSky4PufjlsBukSxPfddO0b8e9knK88e6BiL4NqT6vThtXmUGtw Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: fd2aa669094b46b98206493668c99895 Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 22:02:10.069283 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 22:02:10.070814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fd2aa669094b46b98206493668c99895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fd2aa669094b46b98206493668c99895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fd2aa669094b46b98206493668c99895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fd2aa669094b46b98206493668c99895"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:02:10.070814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.070814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: fd2aa669094b46b98206493668c99895 Aug 29 22:02:10.070814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.070814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-VolumesNegativeTest-261854158-project Aug 29 22:02:10.070814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 22:02:10.070814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 22:02:10.070814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 0d3eb13e12cc466cac39ab025fe760b3 Aug 29 22:02:10.070814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-VolumesNegativeTest-261854158-project Aug 29 22:02:10.070814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Aug 29 22:02:10.070814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1279571688", "metadata": {"Type": "work"}}} Aug 29 22:02:10.070814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: Aug 29 22:02:10.070814 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1279571688', 'metadata': {'Type': 'work'}}}} Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise error Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi '' Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:02:10.072383 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 22:02:10.074193 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 22:02:10.076793 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 22:02:10.076793 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.076793 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-a9fd1e4c-3c84-4fad-a0b7-ccc784a067a8 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:02:10.076793 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-a9fd1e4c-3c84-4fad-a0b7-ccc784a067a8 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] 10.222.0.83 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010624 Aug 29 22:02:10.076793 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 580/1153] 10.222.0.83 () {60 vars in 1156 bytes} [Mon Aug 29 22:02:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 22:02:10.081493 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-feb48176-1028-4983-b987-a1964621dd62 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Calling method '.version_select at 0x7f5040897940>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:02:10.113571 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-feb48176-1028-4983-b987-a1964621dd62 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] HTTP exception thrown: Volume tempest-invalid-1379113390 could not be found. Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-feb48176-1028-4983-b987-a1964621dd62 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Request method failure captured: Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1379113390 HTTP/1.1 Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTdhtlYCH8BWOdzasajnCss7MInxOWgEnOnEuW6Q2-6jDaXCWWdoHfftc-wvbx5damehkdqE8GxihgdgOTDwo7WDBAeRSArJMln2QghG8jNm1WTwe66DSdeKvLl4aSky4PufjlsBukSxPfddO0b8e9knK88e6BiL4NqT6vThtXmUGtw Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: fd2aa669094b46b98206493668c99895 Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 22:02:10.128416 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 22:02:10.137672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fd2aa669094b46b98206493668c99895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fd2aa669094b46b98206493668c99895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fd2aa669094b46b98206493668c99895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fd2aa669094b46b98206493668c99895"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:02:10.137672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.137672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: fd2aa669094b46b98206493668c99895 Aug 29 22:02:10.137672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.137672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-VolumesNegativeTest-261854158-project Aug 29 22:02:10.137672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 22:02:10.137672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 22:02:10.137672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 0d3eb13e12cc466cac39ab025fe760b3 Aug 29 22:02:10.137672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-VolumesNegativeTest-261854158-project Aug 29 22:02:10.137672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: Aug 29 22:02:10.137672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Volume tempest-invalid-1379113390 could not be found. Aug 29 22:02:10.137672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': 'tempest-invalid-1379113390'} Aug 29 22:02:10.137672 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1379113390 could not be found. (HTTP 404) (Request-ID: req-50eb1935-7900-47d0-b2c5-bc4a603cdfb0) Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:10.138700 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:02:10.140361 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1379113390 could not be found. Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:02:10.145475 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1379113390 could not be found. Aug 29 22:02:10.147247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.147247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:10.147247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.147247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.147247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:10.147247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:10.147247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:02:10.147247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:02:10.147247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1379113390 could not be found. Aug 29 22:02:10.147247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.147247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-feb48176-1028-4983-b987-a1964621dd62 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Returning 404 to user: Volume tempest-invalid-1379113390 could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:02:10.147247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-feb48176-1028-4983-b987-a1964621dd62 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1379113390" status: 404 len: 99 microversion: 2.1 time: 0.052220 Aug 29 22:02:10.147247 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 574/1154] 10.222.0.83 () {58 vars in 1218 bytes} [Mon Aug 29 22:02:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1379113390 => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 29 22:02:10.148343 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-28633a8b-dfec-4cfe-b5f2-e4a27b87e0ab tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003690 Aug 29 22:02:10.148343 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 581/1155] 10.222.0.83 () {58 vars in 1140 bytes} [Mon Aug 29 22:02:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 22:02:10.149218 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-f0dd39a1-bb91-439c-9c6e-35dbc871b61e tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003815 Aug 29 22:02:10.149710 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 575/1156] 10.222.0.83 () {58 vars in 1137 bytes} [Mon Aug 29 22:02:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 29 22:02:10.164007 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c20713dd-645f-4b36-a9ad-2f5c5e0fcd90 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Calling method '.version_select at 0x7f5040700e50>' {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:02:10.193591 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.wsgi [None req-c20713dd-645f-4b36-a9ad-2f5c5e0fcd90 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] HTTP exception thrown: Volume e9f4b107-22e0-4fe3-9d48-3abc90dde810 could not be found. Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c20713dd-645f-4b36-a9ad-2f5c5e0fcd90 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Request method failure captured: Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: request: DELETE /compute/v2.1/os-volumes/e9f4b107-22e0-4fe3-9d48-3abc90dde810 HTTP/1.1 Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept: application/json Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Accept-Encoding: identity Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Connection: close Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Length: 0 Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Content-Type: application/json Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Host: 10.222.0.83 Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: Openstack-System-Scope: None Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: User-Agent: python-urllib3/1.26.12 Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Auth-Token: gAAAAABjDTdhtlYCH8BWOdzasajnCss7MInxOWgEnOnEuW6Q2-6jDaXCWWdoHfftc-wvbx5damehkdqE8GxihgdgOTDwo7WDBAeRSArJMln2QghG8jNm1WTwe66DSdeKvLl4aSky4PufjlsBukSxPfddO0b8e9knK88e6BiL4NqT6vThtXmUGtw Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Id: None Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Domain-Name: None Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Identity-Status: Confirmed Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Is-Admin-Project: True Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Id: default Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Domain-Name: Default Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Id: fd2aa669094b46b98206493668c99895 Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Project-Name: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Role: reader,member Aug 29 22:02:10.195609 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Roles: reader,member Aug 29 22:02:10.198999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fd2aa669094b46b98206493668c99895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fd2aa669094b46b98206493668c99895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fd2aa669094b46b98206493668c99895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fd2aa669094b46b98206493668c99895"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:02:10.198999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.198999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Id: fd2aa669094b46b98206493668c99895 Aug 29 22:02:10.198999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-Tenant-Name: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.198999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User: tempest-VolumesNegativeTest-261854158-project Aug 29 22:02:10.198999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Id: default Aug 29 22:02:10.198999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Domain-Name: Default Aug 29 22:02:10.198999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Id: 0d3eb13e12cc466cac39ab025fe760b3 Aug 29 22:02:10.198999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: X-User-Name: tempest-VolumesNegativeTest-261854158-project Aug 29 22:02:10.198999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: method: Aug 29 22:02:10.198999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: exception: Volume e9f4b107-22e0-4fe3-9d48-3abc90dde810 could not be found. Aug 29 22:02:10.198999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: action_args: {'id': 'e9f4b107-22e0-4fe3-9d48-3abc90dde810'} Aug 29 22:02:10.198999 dv-cinder-854266-3-smb devstack@n-api.service[127882]: {{(pid=127882) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9f4b107-22e0-4fe3-9d48-3abc90dde810 could not be found. (HTTP 404) (Request-ID: req-1bc07454-89dc-4c03-ae53-a8bee35a18a8) Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:10.200880 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:02:10.203717 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9f4b107-22e0-4fe3-9d48-3abc90dde810 could not be found. Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 22:02:10.206477 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:02:10.209151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9f4b107-22e0-4fe3-9d48-3abc90dde810 could not be found. Aug 29 22:02:10.209151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.209151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:10.209151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.209151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.209151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:10.209151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:10.209151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:02:10.209151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:02:10.209151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9f4b107-22e0-4fe3-9d48-3abc90dde810 could not be found. Aug 29 22:02:10.209151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.209151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: DEBUG nova.api.openstack.wsgi [None req-c20713dd-645f-4b36-a9ad-2f5c5e0fcd90 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Returning 404 to user: Volume e9f4b107-22e0-4fe3-9d48-3abc90dde810 could not be found. {{(pid=127882) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:02:10.209151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: INFO nova.api.openstack.requestlog [None req-c20713dd-645f-4b36-a9ad-2f5c5e0fcd90 tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] 10.222.0.83 "DELETE /compute/v2.1/os-volumes/e9f4b107-22e0-4fe3-9d48-3abc90dde810" status: 404 len: 109 microversion: 2.1 time: 0.037527 Aug 29 22:02:10.209151 dv-cinder-854266-3-smb devstack@n-api.service[127882]: [pid: 127882|app: 0|req: 582/1157] 10.222.0.83 () {58 vars in 1248 bytes} [Mon Aug 29 22:02:10 2022] DELETE /compute/v2.1/os-volumes/e9f4b107-22e0-4fe3-9d48-3abc90dde810 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:02:10.212324 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-505261ed-da26-4344-b72c-b469ca6a626a tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Calling method '.version_select at 0x7f5040897700>' {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:02:10.239658 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.wsgi [None req-505261ed-da26-4344-b72c-b469ca6a626a tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] HTTP exception thrown: Volume ef48184e-e858-4c41-a27e-50716e96f99c could not be found. Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-505261ed-da26-4344-b72c-b469ca6a626a tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Request method failure captured: Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: request: GET /compute/v2.1/os-volumes/ef48184e-e858-4c41-a27e-50716e96f99c HTTP/1.1 Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept: application/json Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Accept-Encoding: identity Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Connection: close Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Length: 0 Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Content-Type: application/json Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Host: 10.222.0.83 Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: Openstack-System-Scope: None Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: User-Agent: python-urllib3/1.26.12 Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Auth-Token: gAAAAABjDTdhtlYCH8BWOdzasajnCss7MInxOWgEnOnEuW6Q2-6jDaXCWWdoHfftc-wvbx5damehkdqE8GxihgdgOTDwo7WDBAeRSArJMln2QghG8jNm1WTwe66DSdeKvLl4aSky4PufjlsBukSxPfddO0b8e9knK88e6BiL4NqT6vThtXmUGtw Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Id: None Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Domain-Name: None Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Identity-Status: Confirmed Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Is-Admin-Project: True Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Id: default Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Domain-Name: Default Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Id: fd2aa669094b46b98206493668c99895 Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Project-Name: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Role: reader,member Aug 29 22:02:10.241648 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Roles: reader,member Aug 29 22:02:10.243890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fd2aa669094b46b98206493668c99895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.83:8080", "publicURL": "http://10.222.0.83:8080/v1/AUTH_fd2aa669094b46b98206493668c99895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/compute/v2/fd2aa669094b46b98206493668c99895"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/volume/v3/fd2aa669094b46b98206493668c99895"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.83/image"}]}] Aug 29 22:02:10.243890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.243890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Id: fd2aa669094b46b98206493668c99895 Aug 29 22:02:10.243890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-Tenant-Name: tempest-VolumesNegativeTest-261854158 Aug 29 22:02:10.243890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User: tempest-VolumesNegativeTest-261854158-project Aug 29 22:02:10.243890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Id: default Aug 29 22:02:10.243890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Domain-Name: Default Aug 29 22:02:10.243890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Id: 0d3eb13e12cc466cac39ab025fe760b3 Aug 29 22:02:10.243890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: X-User-Name: tempest-VolumesNegativeTest-261854158-project Aug 29 22:02:10.243890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: method: Aug 29 22:02:10.243890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: exception: Volume ef48184e-e858-4c41-a27e-50716e96f99c could not be found. Aug 29 22:02:10.243890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: action_args: {'id': 'ef48184e-e858-4c41-a27e-50716e96f99c'} Aug 29 22:02:10.243890 dv-cinder-854266-3-smb devstack@n-api.service[127883]: {{(pid=127883) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ef48184e-e858-4c41-a27e-50716e96f99c could not be found. (HTTP 404) (Request-ID: req-9e78228a-0d68-44e8-a6d1-f884a486b796) Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:10.244938 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:02:10.246629 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ef48184e-e858-4c41-a27e-50716e96f99c could not be found. Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 22:02:10.248228 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:02:10.249740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ef48184e-e858-4c41-a27e-50716e96f99c could not be found. Aug 29 22:02:10.249740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.249740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:02:10.249740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.249740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:02:10.249740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:02:10.249740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:02:10.249740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:02:10.249740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:02:10.249740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ef48184e-e858-4c41-a27e-50716e96f99c could not be found. Aug 29 22:02:10.249740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: ERROR nova.api.openstack.wsgi Aug 29 22:02:10.249740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: DEBUG nova.api.openstack.wsgi [None req-505261ed-da26-4344-b72c-b469ca6a626a tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] Returning 404 to user: Volume ef48184e-e858-4c41-a27e-50716e96f99c could not be found. {{(pid=127883) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:02:10.249740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: INFO nova.api.openstack.requestlog [None req-505261ed-da26-4344-b72c-b469ca6a626a tempest-VolumesNegativeTest-261854158 tempest-VolumesNegativeTest-261854158-project] 10.222.0.83 "GET /compute/v2.1/os-volumes/ef48184e-e858-4c41-a27e-50716e96f99c" status: 404 len: 109 microversion: 2.1 time: 0.037212 Aug 29 22:02:10.249740 dv-cinder-854266-3-smb devstack@n-api.service[127883]: [pid: 127883|app: 0|req: 576/1158] 10.222.0.83 () {58 vars in 1245 bytes} [Mon Aug 29 22:02:10 2022] GET /compute/v2.1/os-volumes/ef48184e-e858-4c41-a27e-50716e96f99c => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)